I0703 15:05:32.221454 1 options.go:220] external host was not specified, using 199.204.45.248 I0703 15:05:32.222535 1 server.go:148] Version: v1.28.13 I0703 15:05:32.222588 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0703 15:05:32.617370 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0703 15:05:32.623749 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0703 15:05:32.623769 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0703 15:05:32.623944 1 instance.go:298] Using reconciler: lease I0703 15:05:32.683820 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0703 15:05:32.683849 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0703 15:05:32.948542 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0703 15:05:32.948750 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0703 15:05:33.447399 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0703 15:05:33.457619 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0703 15:05:33.457655 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.457664 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.458186 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0703 15:05:33.458204 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0703 15:05:33.459870 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0703 15:05:33.461213 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0703 15:05:33.461240 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0703 15:05:33.461251 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0703 15:05:33.463724 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0703 15:05:33.463751 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0703 15:05:33.465368 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0703 15:05:33.465397 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.465406 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.466475 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0703 15:05:33.466523 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.466590 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0703 15:05:33.467291 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0703 15:05:33.469215 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0703 15:05:33.469232 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.469237 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.469729 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0703 15:05:33.469746 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.469750 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.470651 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0703 15:05:33.470666 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0703 15:05:33.472670 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0703 15:05:33.472687 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.472692 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.473134 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0703 15:05:33.473155 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.473161 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.475867 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0703 15:05:33.475889 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.475896 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.477149 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0703 15:05:33.478443 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0703 15:05:33.478459 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.478464 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.481705 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0703 15:05:33.481726 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0703 15:05:33.481730 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0703 15:05:33.482506 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0703 15:05:33.482519 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0703 15:05:33.482523 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0703 15:05:33.482955 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0703 15:05:33.482967 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0703 15:05:33.515070 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0703 15:05:33.515106 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0703 15:05:33.934025 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0703 15:05:33.934040 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0703 15:05:33.934184 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0703 15:05:33.934370 1 secure_serving.go:213] Serving securely on [::]:6443 I0703 15:05:33.934419 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0703 15:05:33.934445 1 controller.go:80] Starting OpenAPI V3 AggregationController I0703 15:05:33.934467 1 controller.go:78] Starting OpenAPI AggregationController I0703 15:05:33.934475 1 available_controller.go:423] Starting AvailableConditionController I0703 15:05:33.934484 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0703 15:05:33.934521 1 aggregator.go:164] waiting for initial CRD sync... I0703 15:05:33.934557 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0703 15:05:33.934566 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0703 15:05:33.934631 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0703 15:05:33.934649 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0703 15:05:33.934634 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0703 15:05:33.934715 1 system_namespaces_controller.go:67] Starting system namespaces controller I0703 15:05:33.934728 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0703 15:05:33.934735 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0703 15:05:33.934785 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0703 15:05:33.934813 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0703 15:05:33.934807 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0703 15:05:33.934855 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0703 15:05:33.934852 1 controller.go:134] Starting OpenAPI controller I0703 15:05:33.934879 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0703 15:05:33.934862 1 naming_controller.go:291] Starting NamingConditionController I0703 15:05:33.934818 1 controller.go:116] Starting legacy_token_tracking_controller I0703 15:05:33.934916 1 controller.go:85] Starting OpenAPI V3 controller I0703 15:05:33.934934 1 establishing_controller.go:76] Starting EstablishingController I0703 15:05:33.934921 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0703 15:05:33.934912 1 crd_finalizer.go:266] Starting CRDFinalizer I0703 15:05:33.934755 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0703 15:05:33.934986 1 gc_controller.go:78] Starting apiserver lease garbage collector I0703 15:05:33.934823 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0703 15:05:33.936949 1 gc_controller.go:78] Starting apiserver lease garbage collector E0703 15:05:34.008823 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0703 15:05:34.017524 1 shared_informer.go:318] Caches are synced for node_authorizer I0703 15:05:34.034829 1 cache.go:39] Caches are synced for AvailableConditionController controller I0703 15:05:34.034988 1 shared_informer.go:318] Caches are synced for configmaps I0703 15:05:34.035243 1 shared_informer.go:318] Caches are synced for crd-autoregister I0703 15:05:34.035286 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0703 15:05:34.035312 1 aggregator.go:166] initial CRD sync complete... I0703 15:05:34.035364 1 apf_controller.go:379] Running API Priority and Fairness config worker I0703 15:05:34.035442 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0703 15:05:34.035376 1 autoregister_controller.go:141] Starting autoregister controller I0703 15:05:34.035629 1 cache.go:32] Waiting for caches to sync for autoregister controller I0703 15:05:34.035648 1 cache.go:39] Caches are synced for autoregister controller I0703 15:05:34.036343 1 controller.go:624] quota admission added evaluator for: namespaces I0703 15:05:34.037397 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0703 15:05:34.213733 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0703 15:05:34.943451 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0703 15:05:34.949122 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0703 15:05:34.949173 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0703 15:05:35.817402 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0703 15:05:35.903411 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0703 15:05:36.145737 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0703 15:05:36.151696 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0703 15:05:36.163218 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.248] I0703 15:05:36.164749 1 controller.go:624] quota admission added evaluator for: endpoints I0703 15:05:36.174139 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0703 15:05:38.040852 1 controller.go:624] quota admission added evaluator for: deployments.apps I0703 15:05:38.055258 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0703 15:05:38.212191 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0703 15:05:40.431545 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0703 15:05:41.282901 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0703 15:06:11.750479 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0703 15:06:11.769025 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0703 15:06:11.807670 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0703 15:06:11.807786 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0703 15:06:11.819868 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0703 15:06:11.852225 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0703 15:06:11.864055 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0703 15:06:11.888328 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0703 15:06:11.908101 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0703 15:06:11.908168 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0703 15:06:11.989586 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0703 15:06:11.989678 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0703 15:06:12.050935 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0703 15:06:12.051017 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0703 15:06:12.126542 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0703 15:06:12.237882 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0703 15:06:12.237979 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0703 15:06:12.254963 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:12.333061 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:12.440772 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:12.559660 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:12.599446 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:13.056734 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:13.058895 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:13.136424 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0703 15:06:18.741898 1 controller.go:624] quota admission added evaluator for: jobs.batch I0703 15:06:19.887270 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0703 15:06:19.893589 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0703 15:06:20.101188 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0703 15:06:20.296654 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0703 15:06:20.488125 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0703 15:06:20.689061 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0703 15:06:21.096899 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0703 15:06:21.313324 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0703 15:06:22.714863 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0703 15:06:23.517470 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0703 15:06:23.891202 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0703 15:06:30.100574 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0703 15:06:30.100619 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0703 15:06:30.565842 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0703 15:06:38.464080 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.108.70.138"} W0703 15:06:38.519523 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.70.138:9443: connect: connection refused E0703 15:06:38.519589 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.70.138:9443: connect: connection refused I0703 15:06:52.155167 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0703 15:06:52.170921 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0703 15:06:52.193054 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0703 15:06:52.237860 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.108.178.9"} I0703 15:06:52.265372 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.106.20.157"} I0703 15:06:52.271800 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0703 15:06:52.321734 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0703 15:06:52.402233 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0703 15:06:58.071754 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.108.178.9:443: connect: connection refused I0703 15:07:03.066487 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0703 15:07:07.513126 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0703 15:07:21.774174 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.106.186.177"} I0703 15:07:21.786005 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.103.82.156"} I0703 15:07:21.799382 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.179.181"} I0703 15:07:21.812834 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.104.2.31"} I0703 15:07:28.368095 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.387891 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.415533 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.437816 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.453703 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.472198 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.490747 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.509797 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.537749 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.554680 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0703 15:07:28.572553 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.600215 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:28.617226 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:30.084051 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0703 15:07:33.967860 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0703 15:07:33.979211 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0703 15:07:34.050705 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.97.168.211"} I0703 15:07:34.082822 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0703 15:07:36.431778 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0703 15:07:36.461671 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0703 15:07:37.167951 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0703 15:07:37.168019 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0703 15:07:37.168237 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0703 15:07:44.251718 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0703 15:07:47.264199 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.110.54.178"} I0703 15:07:47.541129 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0703 15:07:47.690563 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.111.129.235"} I0703 15:07:47.705259 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.105.25.212"} I0703 15:09:06.647592 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.104.73.48"} I0703 15:09:09.189340 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.105.136.195"} I0703 15:09:09.204625 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.109.87.65"} I0703 15:09:15.763531 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.104.40.215"} I0703 15:09:15.774163 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.101.215.172"} I0703 15:11:49.653500 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0703 15:11:53.573332 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0703 15:11:53.608520 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0703 15:11:57.614332 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0703 15:11:57.626896 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0703 15:11:57.641119 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0703 15:11:57.656425 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0703 15:11:57.667456 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0703 15:11:57.676905 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0703 15:11:57.694078 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0703 15:11:59.754944 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0703 15:12:10.479596 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0703 15:12:50.115640 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0703 15:13:04.586721 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0703 15:13:04.782703 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0703 15:13:04.804185 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0703 15:13:04.826007 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0703 15:13:05.070064 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0703 15:13:05.345376 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0703 15:13:05.421886 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0703 15:13:05.431070 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0703 15:13:05.632840 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0703 15:13:47.774437 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.108.15.65"} I0703 15:13:47.795861 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.104.86.164"} I0703 15:13:47.799844 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.104.167.54"} I0703 15:13:47.806338 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.100.251.69"} I0703 15:13:47.815958 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.96.244.203"} I0703 15:13:47.822848 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.108.242.160"} I0703 15:13:47.868229 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0703 15:13:47.884367 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0703 15:13:47.929563 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0703 15:13:47.943691 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0703 15:13:47.976483 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0703 15:13:47.994675 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.994723 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.994861 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.994906 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995486 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995528 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995567 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995587 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995611 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995617 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995663 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995667 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995684 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995690 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995700 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995739 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.995951 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.995976 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.996022 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.996057 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.996670 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.996737 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.996949 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.996997 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.997550 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.997583 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.997578 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.997599 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.997768 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.997792 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused W0703 15:13:47.999678 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused E0703 15:13:47.999711 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.108.242.160:443: connect: connection refused I0703 15:13:58.606627 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.96.12.194"} I0703 15:13:58.616799 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.96.222.217"} I0703 15:14:03.022045 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.99.100.182"} I0703 15:14:05.941983 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-smartctl-exporter" clusterIPs={"IPv4":"10.109.61.254"} I0703 15:14:08.020599 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.109.25.188"} I0703 15:14:13.123169 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.102.183.249"} I0703 15:14:14.366509 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.97.237.86"} I0703 15:14:21.416909 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0703 15:14:21.592015 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.174.251"} I0703 15:15:02.607370 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.108.11.210"} I0703 15:15:02.622855 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0703 15:18:09.047803 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.101.73.128"} I0703 15:18:42.449287 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.102.14.102"} I0703 15:20:39.147669 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.174447 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0703 15:20:39.237310 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0703 15:20:39.265148 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.286246 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.309213 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.344668 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.353739 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.372992 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.384800 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.402580 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.415999 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.437972 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.462503 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.480420 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.511695 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.555536 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.582444 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:20:39.678523 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0703 15:21:20.022491 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0703 15:21:20.033348 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0703 15:21:53.536859 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.109.209.84"} I0703 15:21:55.410920 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.106.71.174"} I0703 15:22:29.124759 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.104.234.136"} I0703 15:22:35.714542 1 trace.go:236] Trace[1305232355]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d5764f8c-256b-4761-95b0-74ae706d9cab,client:10.0.0.111,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:22:34.852) (total time: 862ms): Trace[1305232355]: ["GuaranteedUpdate etcd3" audit-id:d5764f8c-256b-4761-95b0-74ae706d9cab,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 861ms (15:22:34.852) Trace[1305232355]: ---"Txn call completed" 860ms (15:22:35.714)] Trace[1305232355]: [862.053026ms] [862.053026ms] END I0703 15:22:35.747386 1 trace.go:236] Trace[2083959502]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1d720a84-d4ad-444c-8feb-b4bb96753ac8,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:22:34.855) (total time: 892ms): Trace[2083959502]: ["GuaranteedUpdate etcd3" audit-id:1d720a84-d4ad-444c-8feb-b4bb96753ac8,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 891ms (15:22:34.855) Trace[2083959502]: ---"Txn call completed" 890ms (15:22:35.746)] Trace[2083959502]: [892.204611ms] [892.204611ms] END I0703 15:22:35.748016 1 trace.go:236] Trace[627348068]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8cfc43db-fc80-49f5-b92a-dc27ae1e4965,client:199.204.45.248,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/glance-db-init/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (03-Jul-2026 15:22:35.213) (total time: 534ms): Trace[627348068]: ["GuaranteedUpdate etcd3" audit-id:8cfc43db-fc80-49f5-b92a-dc27ae1e4965,key:/jobs/openstack/glance-db-init,type:*batch.Job,resource:jobs.batch 533ms (15:22:35.214) Trace[627348068]: ---"Txn call completed" 530ms (15:22:35.746)] Trace[627348068]: [534.22159ms] [534.22159ms] END I0703 15:25:06.918569 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.96.167.159"} I0703 15:25:28.446154 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-cinder" clusterIPs={"IPv4":"10.98.12.220"} I0703 15:26:03.401865 1 alloc.go:330] "allocated clusterIPs" service="openstack/cinder-api" clusterIPs={"IPv4":"10.99.216.170"} I0703 15:29:03.736960 1 trace.go:236] Trace[1038537054]: "Get" accept:application/json, */*,audit-id:6f70e7a3-cab8-4558-b9ee-65f0edd33df0,client:10.0.0.147,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/cinder-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:29:03.151) (total time: 585ms): Trace[1038537054]: ---"About to write a response" 585ms (15:29:03.736) Trace[1038537054]: [585.536432ms] [585.536432ms] END I0703 15:29:03.736961 1 trace.go:236] Trace[615524890]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ea8a0830-d8f9-4301-9a30-f2767a982eaa,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:29:03.219) (total time: 517ms): Trace[615524890]: ["GuaranteedUpdate etcd3" audit-id:ea8a0830-d8f9-4301-9a30-f2767a982eaa,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 517ms (15:29:03.219) Trace[615524890]: ---"Txn call completed" 516ms (15:29:03.736)] Trace[615524890]: [517.866102ms] [517.866102ms] END I0703 15:30:53.496851 1 alloc.go:330] "allocated clusterIPs" service="openstack/placement-api" clusterIPs={"IPv4":"10.103.143.113"} I0703 15:33:24.598291 1 alloc.go:330] "allocated clusterIPs" service="openstack/ovn-ovsdb-nb" clusterIPs={"IPv4":"10.110.178.134"} I0703 15:33:24.607809 1 alloc.go:330] "allocated clusterIPs" service="openstack/ovn-ovsdb-sb" clusterIPs={"IPv4":"10.110.195.18"} I0703 15:33:38.532153 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-nova" clusterIPs={"IPv4":"10.100.52.146"} I0703 15:34:16.575408 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-novncproxy" clusterIPs={"IPv4":"10.106.103.155"} I0703 15:34:16.583187 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-metadata" clusterIPs={"IPv4":"10.98.244.101"} I0703 15:34:16.591374 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-api" clusterIPs={"IPv4":"10.102.181.214"} I0703 15:37:32.854803 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-neutron" clusterIPs={"IPv4":"10.105.14.218"} I0703 15:38:08.570186 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-server" clusterIPs={"IPv4":"10.97.84.25"} I0703 15:45:26.171722 1 trace.go:236] Trace[1979559447]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b0888caf-dd0a-4023-9f54-374260b0878d,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (03-Jul-2026 15:45:23.136) (total time: 3035ms): Trace[1979559447]: ["GuaranteedUpdate etcd3" audit-id:b0888caf-dd0a-4023-9f54-374260b0878d,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3035ms (15:45:23.136) Trace[1979559447]: ---"Txn call completed" 3034ms (15:45:26.171)] Trace[1979559447]: [3.035598736s] [3.035598736s] END I0703 15:45:26.183247 1 trace.go:236] Trace[733081644]: "Get" accept:application/json, */*,audit-id:ca330ab4-ca2c-469b-b2d1-dc7f564a0864,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:24.324) (total time: 1858ms): Trace[733081644]: ---"About to write a response" 1858ms (15:45:26.183) Trace[733081644]: [1.858209702s] [1.858209702s] END I0703 15:45:26.184167 1 trace.go:236] Trace[678795994]: "Get" accept:application/json, */*,audit-id:fcb4e45b-506f-4d1b-917e-dddae63e103e,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:24.796) (total time: 1387ms): Trace[678795994]: ---"About to write a response" 1387ms (15:45:26.183) Trace[678795994]: [1.387289089s] [1.387289089s] END I0703 15:45:26.184204 1 trace.go:236] Trace[717063635]: "Get" accept:application/json, */*,audit-id:7ef230ef-fa5a-4b97-994c-5c5fc6186a45,client:10.0.0.166,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-b47vv,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:24.420) (total time: 1763ms): Trace[717063635]: ---"About to write a response" 1762ms (15:45:26.183) Trace[717063635]: [1.763343343s] [1.763343343s] END I0703 15:45:26.184287 1 trace.go:236] Trace[2004579705]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:341d5c2f-856b-403d-9405-aaef4ac33552,client:10.0.0.206,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:25.253) (total time: 930ms): Trace[2004579705]: ---"About to write a response" 930ms (15:45:26.183) Trace[2004579705]: [930.611913ms] [930.611913ms] END I0703 15:45:26.187512 1 trace.go:236] Trace[916679721]: "Get" accept:application/json, */*,audit-id:c1554354-20bb-4c6f-b118-ae2d741fd803,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:24.325) (total time: 1862ms): Trace[916679721]: ---"About to write a response" 1862ms (15:45:26.187) Trace[916679721]: [1.862249544s] [1.862249544s] END I0703 15:45:26.188796 1 trace.go:236] Trace[1279721782]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0bfc1ca9-55a1-4657-ad62-b71d9c1843ae,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (03-Jul-2026 15:45:23.849) (total time: 2339ms): Trace[1279721782]: ["GuaranteedUpdate etcd3" audit-id:0bfc1ca9-55a1-4657-ad62-b71d9c1843ae,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 2339ms (15:45:23.849) Trace[1279721782]: ---"Txn call completed" 2338ms (15:45:26.188)] Trace[1279721782]: [2.339760199s] [2.339760199s] END I0703 15:45:26.189142 1 trace.go:236] Trace[361582723]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9bede8c5-2c7a-42c5-94bc-ffa44dd8bc4f,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (03-Jul-2026 15:45:24.157) (total time: 2031ms): Trace[361582723]: ---"About to write a response" 2031ms (15:45:26.188) Trace[361582723]: [2.031439113s] [2.031439113s] END I0703 15:45:26.189308 1 trace.go:236] Trace[1871769616]: "Get" accept:application/json, */*,audit-id:0ebd1460-6628-49f0-ba91-14ed223ab5f6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:24.850) (total time: 1338ms): Trace[1871769616]: ---"About to write a response" 1338ms (15:45:26.189) Trace[1871769616]: [1.338444576s] [1.338444576s] END I0703 15:45:26.189143 1 trace.go:236] Trace[160997579]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9fcbecd8-59d2-4474-940b-576bc121d371,client:10.0.0.175,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:23.870) (total time: 2318ms): Trace[160997579]: ["GuaranteedUpdate etcd3" audit-id:9fcbecd8-59d2-4474-940b-576bc121d371,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2318ms (15:45:23.870) Trace[160997579]: ---"Txn call completed" 2317ms (15:45:26.188)] Trace[160997579]: [2.318471969s] [2.318471969s] END I0703 15:45:26.189471 1 trace.go:236] Trace[251725860]: "Get" accept:application/json, */*,audit-id:9260e1a9-4be3-444b-827d-562272b2635c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:23.977) (total time: 2211ms): Trace[251725860]: ---"About to write a response" 2211ms (15:45:26.189) Trace[251725860]: [2.211477193s] [2.211477193s] END I0703 15:45:26.189665 1 trace.go:236] Trace[197539619]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a1cc6881-4f4d-41b5-9d85-9a14f5ef2506,client:10.0.0.111,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:23.662) (total time: 2527ms): Trace[197539619]: ["GuaranteedUpdate etcd3" audit-id:a1cc6881-4f4d-41b5-9d85-9a14f5ef2506,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2527ms (15:45:23.662) Trace[197539619]: ---"Txn call completed" 2526ms (15:45:26.189)] Trace[197539619]: [2.527182704s] [2.527182704s] END I0703 15:45:26.189317 1 trace.go:236] Trace[122064976]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ce5a63c8-e0fb-49ea-8e7c-1249becb0a5f,client:10.0.0.131,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:23.867) (total time: 2321ms): Trace[122064976]: ["GuaranteedUpdate etcd3" audit-id:ce5a63c8-e0fb-49ea-8e7c-1249becb0a5f,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2321ms (15:45:23.867) Trace[122064976]: ---"Txn call completed" 2320ms (15:45:26.189)] Trace[122064976]: [2.321499283s] [2.321499283s] END I0703 15:45:26.189759 1 trace.go:236] Trace[1004487778]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8a931330-f044-406b-93b6-8f95d808bae3,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:23.867) (total time: 2321ms): Trace[1004487778]: ["GuaranteedUpdate etcd3" audit-id:8a931330-f044-406b-93b6-8f95d808bae3,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2321ms (15:45:23.867) Trace[1004487778]: ---"Txn call completed" 2320ms (15:45:26.189)] Trace[1004487778]: [2.321836922s] [2.321836922s] END I0703 15:45:26.189976 1 trace.go:236] Trace[1678654867]: "Update" accept:application/json, */*,audit-id:9230c397-dc1e-4cd8-9f39-e76723cf531c,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:23.137) (total time: 3052ms): Trace[1678654867]: ["GuaranteedUpdate etcd3" audit-id:9230c397-dc1e-4cd8-9f39-e76723cf531c,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3052ms (15:45:23.137) Trace[1678654867]: ---"Txn call completed" 3051ms (15:45:26.189)] Trace[1678654867]: [3.052622787s] [3.052622787s] END E0703 15:45:35.183680 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0703 15:45:35.183906 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.185679 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.185765 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:35.187039 1 trace.go:236] Trace[1685837553]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dee7b837-d8b2-4693-8ab9-748ae08d15d4,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (03-Jul-2026 15:45:30.184) (total time: 5002ms): Trace[1685837553]: [5.002078099s] [5.002078099s] END E0703 15:45:35.187346 1 timeout.go:142] post-timeout activity - time-elapsed: 3.761225ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0703 15:45:35.197338 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.197366 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.197404 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.8µs, panicked: false, err: context canceled, panic-reason: E0703 15:45:35.198618 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:35.198772 1 trace.go:236] Trace[2035368660]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c4d07bd3-d847-4469-9014-8fb7fed8be8e,client:10.0.0.131,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:30.198) (total time: 5000ms): Trace[2035368660]: ["GuaranteedUpdate etcd3" audit-id:c4d07bd3-d847-4469-9014-8fb7fed8be8e,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (15:45:30.198) Trace[2035368660]: ---"Txn call failed" err:context canceled 4998ms (15:45:35.197)] Trace[2035368660]: [5.000585098s] [5.000585098s] END E0703 15:45:35.198929 1 timeout.go:142] post-timeout activity - time-elapsed: 1.747568ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0703 15:45:35.200313 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.88µs, panicked: false, err: context deadline exceeded, panic-reason: E0703 15:45:35.200348 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.201045 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.201080 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.69µs, panicked: false, err: context deadline exceeded, panic-reason: E0703 15:45:35.201733 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.201750 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.201842 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 4.07µs, panicked: false, err: context deadline exceeded, panic-reason: E0703 15:45:35.202073 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.202155 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0703 15:45:35.202801 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:35.203643 1 trace.go:236] Trace[871894400]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c57487c3-0f3d-44b3-be75-231c78c461cd,client:10.0.0.111,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:30.200) (total time: 5003ms): Trace[871894400]: ["GuaranteedUpdate etcd3" audit-id:c57487c3-0f3d-44b3-be75-231c78c461cd,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (15:45:30.200) Trace[871894400]: ---"Txn call failed" err:context deadline exceeded 4998ms (15:45:35.200)] Trace[871894400]: [5.003009985s] [5.003009985s] END I0703 15:45:35.203654 1 trace.go:236] Trace[106397452]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cc475ba5-6f0b-4413-9ec9-c3429595d019,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:30.201) (total time: 5002ms): Trace[106397452]: ["GuaranteedUpdate etcd3" audit-id:cc475ba5-6f0b-4413-9ec9-c3429595d019,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (15:45:30.201) Trace[106397452]: ---"Txn call failed" err:context deadline exceeded 4998ms (15:45:35.200)] Trace[106397452]: [5.002153481s] [5.002153481s] END E0703 15:45:35.203652 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.203729 1 timeout.go:142] post-timeout activity - time-elapsed: 2.647413ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0703 15:45:35.203788 1 timeout.go:142] post-timeout activity - time-elapsed: 3.560299ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0703 15:45:35.203813 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0703 15:45:35.203887 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:35.205262 1 trace.go:236] Trace[1799448059]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cac7faa9-fc97-415b-a932-8f819a4b2853,client:10.0.0.175,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:30.202) (total time: 5003ms): Trace[1799448059]: ["GuaranteedUpdate etcd3" audit-id:cac7faa9-fc97-415b-a932-8f819a4b2853,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (15:45:30.202) Trace[1799448059]: ---"Txn call failed" err:context deadline exceeded 4999ms (15:45:35.201)] Trace[1799448059]: [5.00318462s] [5.00318462s] END E0703 15:45:35.205272 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.205293 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.205388 1 timeout.go:142] post-timeout activity - time-elapsed: 3.406844ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0703 15:45:35.206503 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:35.206555 1 trace.go:236] Trace[1445278411]: "Get" accept:application/json, */*,audit-id:d48d586f-a484-4b8e-97c3-c9402b843259,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:30.204) (total time: 5002ms): Trace[1445278411]: [5.002289855s] [5.002289855s] END E0703 15:45:35.206659 1 timeout.go:142] post-timeout activity - time-elapsed: 2.855599ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0703 15:45:35.209060 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0703 15:45:35.209131 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:35.210274 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:35.210329 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:35.211450 1 trace.go:236] Trace[2027593104]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:06920bd6-ecda-4d2f-900a-a6e96116578d,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (03-Jul-2026 15:45:30.208) (total time: 5002ms): Trace[2027593104]: [5.002531182s] [5.002531182s] END E0703 15:45:35.211601 1 timeout.go:142] post-timeout activity - time-elapsed: 2.5331ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0703 15:45:35.702505 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0703 15:45:35.702753 1 trace.go:236] Trace[1437556727]: "Update" accept:application/json, */*,audit-id:8533ca0f-af11-4884-bd72-91d148a389fd,client:10.0.0.136,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:28.699) (total time: 7002ms): Trace[1437556727]: ["GuaranteedUpdate etcd3" audit-id:8533ca0f-af11-4884-bd72-91d148a389fd,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (15:45:28.699) Trace[1437556727]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (15:45:35.702)] Trace[1437556727]: [7.002974926s] [7.002974926s] END E0703 15:45:37.135103 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0703 15:45:37.135385 1 trace.go:236] Trace[376631519]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e90fb64f-a63c-4c2a-bf54-17b85de2dbb3,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (03-Jul-2026 15:45:30.131) (total time: 7003ms): Trace[376631519]: ["GuaranteedUpdate etcd3" audit-id:e90fb64f-a63c-4c2a-bf54-17b85de2dbb3,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (15:45:30.131) Trace[376631519]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (15:45:37.135)] Trace[376631519]: [7.00386485s] [7.00386485s] END I0703 15:45:37.280050 1 trace.go:236] Trace[1826704761]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8eccb1d7-f8f9-4b08-8009-17a0df018c61,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (03-Jul-2026 15:45:31.965) (total time: 5314ms): Trace[1826704761]: ["GuaranteedUpdate etcd3" audit-id:8eccb1d7-f8f9-4b08-8009-17a0df018c61,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 5314ms (15:45:31.965) Trace[1826704761]: ---"Txn call completed" 5313ms (15:45:37.279)] Trace[1826704761]: [5.314762934s] [5.314762934s] END I0703 15:45:37.281616 1 trace.go:236] Trace[234341101]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:346feb27-8ab2-4310-a098-e89d63ec8835,client:10.0.0.206,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:31.279) (total time: 6001ms): Trace[234341101]: ---"About to write a response" 6001ms (15:45:37.281) Trace[234341101]: [6.001828947s] [6.001828947s] END I0703 15:45:37.281783 1 trace.go:236] Trace[1000920289]: "Get" accept:application/json, */*,audit-id:7b59232e-5cf8-4713-bd00-37b31536ca29,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:30.192) (total time: 7088ms): Trace[1000920289]: ---"About to write a response" 7088ms (15:45:37.281) Trace[1000920289]: [7.088770364s] [7.088770364s] END I0703 15:45:37.283129 1 trace.go:236] Trace[1979530588]: "Get" accept:application/json, */*,audit-id:3beaefdb-429f-45ed-8cc2-17f3cccd48ec,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:30.193) (total time: 7089ms): Trace[1979530588]: ---"About to write a response" 7089ms (15:45:37.282) Trace[1979530588]: [7.089422522s] [7.089422522s] END I0703 15:45:37.284207 1 trace.go:236] Trace[621465024]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0ac943cd-2f37-4e65-bea5-a63a59c1b4e0,client:199.204.45.248,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (03-Jul-2026 15:45:33.149) (total time: 4134ms): Trace[621465024]: ---"About to write a response" 4134ms (15:45:37.284) Trace[621465024]: [4.134894714s] [4.134894714s] END I0703 15:45:37.284553 1 trace.go:236] Trace[1260587433]: "Get" accept:application/json, */*,audit-id:f47e1f94-40e1-48b9-8908-2bfdc451686f,client:10.0.0.166,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-b47vv,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:30.225) (total time: 7059ms): Trace[1260587433]: ---"About to write a response" 7058ms (15:45:37.283) Trace[1260587433]: [7.05939649s] [7.05939649s] END I0703 15:45:37.284932 1 trace.go:236] Trace[271140984]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f28d3ff9-b964-46e4-8f16-e81551c05d3b,client:10.0.0.175,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:35.203) (total time: 2080ms): Trace[271140984]: ---"About to write a response" 2080ms (15:45:37.284) Trace[271140984]: [2.080998717s] [2.080998717s] END I0703 15:45:37.284966 1 trace.go:236] Trace[964719898]: "Get" accept:application/json, */*,audit-id:95d13fff-b5b8-442d-bf25-1340f826545e,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:30.194) (total time: 7090ms): Trace[964719898]: ---"About to write a response" 7090ms (15:45:37.284) Trace[964719898]: [7.090603774s] [7.090603774s] END I0703 15:45:37.284968 1 trace.go:236] Trace[1227408146]: "Get" accept:application/json, */*,audit-id:e55cd021-e11e-49cd-af15-62feec093845,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:30.206) (total time: 7078ms): Trace[1227408146]: ---"About to write a response" 7077ms (15:45:37.284) Trace[1227408146]: [7.078015216s] [7.078015216s] END I0703 15:45:37.285391 1 trace.go:236] Trace[15176059]: "Get" accept:application/json, */*,audit-id:7103aa2d-f960-446e-9ac0-be8056f35eb7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:30.208) (total time: 7076ms): Trace[15176059]: ---"About to write a response" 7076ms (15:45:37.285) Trace[15176059]: [7.07635185s] [7.07635185s] END I0703 15:45:37.285464 1 trace.go:236] Trace[349187379]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:56592988-1e08-47a3-9247-4c06138da582,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (03-Jul-2026 15:45:33.692) (total time: 3592ms): Trace[349187379]: ["GuaranteedUpdate etcd3" audit-id:56592988-1e08-47a3-9247-4c06138da582,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 3592ms (15:45:33.692) Trace[349187379]: ---"Txn call completed" 3591ms (15:45:37.285)] Trace[349187379]: [3.59283094s] [3.59283094s] END I0703 15:45:37.287024 1 trace.go:236] Trace[1799160711]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8f4edee7-cdc4-4d27-8c24-ab35956b108a,client:10.0.0.131,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:35.198) (total time: 2088ms): Trace[1799160711]: ---"About to write a response" 2088ms (15:45:37.286) Trace[1799160711]: [2.088706861s] [2.088706861s] END I0703 15:45:37.287629 1 trace.go:236] Trace[1986278087]: "Get" accept:application/json, */*,audit-id:aad01c3b-736e-4934-80cb-4cbf2c96879b,client:10.0.0.136,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:35.704) (total time: 1583ms): Trace[1986278087]: ---"About to write a response" 1583ms (15:45:37.287) Trace[1986278087]: [1.583328863s] [1.583328863s] END I0703 15:45:37.287798 1 trace.go:236] Trace[371803688]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2ed58a9a-7148-495a-9934-e89d8d353152,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:35.202) (total time: 2085ms): Trace[371803688]: ---"About to write a response" 2085ms (15:45:37.287) Trace[371803688]: [2.085293926s] [2.085293926s] END I0703 15:45:37.287967 1 trace.go:236] Trace[1740361774]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e3ba8c2a-04b4-4d97-9f05-aa583c041922,client:10.0.0.111,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:35.201) (total time: 2086ms): Trace[1740361774]: ---"About to write a response" 2086ms (15:45:37.287) Trace[1740361774]: [2.086397886s] [2.086397886s] END I0703 15:45:37.358928 1 trace.go:236] Trace[1567329853]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2b6e8c39-babf-41ca-a0a7-9566476d3349,client:199.204.45.248,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bed21d65803fe0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (03-Jul-2026 15:45:34.143) (total time: 3215ms): Trace[1567329853]: ["GuaranteedUpdate etcd3" audit-id:2b6e8c39-babf-41ca-a0a7-9566476d3349,key:/events/kube-system/kube-apiserver-instance.18bed21d65803fe0,type:*core.Event,resource:events 3215ms (15:45:34.143) Trace[1567329853]: ---"initial value restored" 3137ms (15:45:37.280) Trace[1567329853]: ---"Txn call completed" 76ms (15:45:37.358)] Trace[1567329853]: ---"Object stored in database" 77ms (15:45:37.358) Trace[1567329853]: [3.215655595s] [3.215655595s] END I0703 15:45:37.405823 1 trace.go:236] Trace[1896206836]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.248,type:*v1.Endpoints,resource:apiServerIPInfo (03-Jul-2026 15:45:36.280) (total time: 1125ms): Trace[1896206836]: ---"initial value restored" 1002ms (15:45:37.283) Trace[1896206836]: ---"Transaction prepared" 76ms (15:45:37.359) Trace[1896206836]: [1.125206627s] [1.125206627s] END I0703 15:45:50.075195 1 trace.go:236] Trace[1405464122]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4640bb44-ceff-4a74-80a9-df2fcdbee26e,client:10.0.0.111,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:45.460) (total time: 4615ms): Trace[1405464122]: ["GuaranteedUpdate etcd3" audit-id:4640bb44-ceff-4a74-80a9-df2fcdbee26e,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4615ms (15:45:45.460) Trace[1405464122]: ---"Txn call completed" 4614ms (15:45:50.075)] Trace[1405464122]: [4.615115514s] [4.615115514s] END E0703 15:45:50.550314 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:50.550370 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:50.550404 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 13µs, panicked: false, err: context canceled, panic-reason: E0703 15:45:50.551482 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:50.551593 1 trace.go:236] Trace[1604920131]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6b00df7b-b0ae-4278-be12-0e7cdaea058d,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:45.550) (total time: 5000ms): Trace[1604920131]: ["GuaranteedUpdate etcd3" audit-id:6b00df7b-b0ae-4278-be12-0e7cdaea058d,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (15:45:45.550) Trace[1604920131]: ---"Txn call failed" err:context canceled 4999ms (15:45:50.550)] Trace[1604920131]: [5.000974566s] [5.000974566s] END E0703 15:45:50.551695 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.591µs, panicked: false, err: context deadline exceeded, panic-reason: E0703 15:45:50.551732 1 timeout.go:142] post-timeout activity - time-elapsed: 1.44272ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0703 15:45:50.551850 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:50.553553 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:50.553584 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:50.553606 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.83µs, panicked: false, err: context deadline exceeded, panic-reason: E0703 15:45:50.553840 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:50.554836 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0703 15:45:50.554867 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:50.554933 1 trace.go:236] Trace[2127840150]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5b830e49-6afc-42aa-8b8d-20078465f251,client:10.0.0.175,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:45.551) (total time: 5002ms): Trace[2127840150]: ["GuaranteedUpdate etcd3" audit-id:5b830e49-6afc-42aa-8b8d-20078465f251,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (15:45:45.552) Trace[2127840150]: ---"Txn call failed" err:context deadline exceeded 4998ms (15:45:50.551)] Trace[2127840150]: [5.002957821s] [5.002957821s] END E0703 15:45:50.555019 1 timeout.go:142] post-timeout activity - time-elapsed: 3.557968ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: I0703 15:45:50.556671 1 trace.go:236] Trace[790366511]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:31e9ce4e-a522-4f0f-8158-49c45c55e7b1,client:10.0.0.131,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:45.553) (total time: 5003ms): Trace[790366511]: ["GuaranteedUpdate etcd3" audit-id:31e9ce4e-a522-4f0f-8158-49c45c55e7b1,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (15:45:45.553) Trace[790366511]: ---"Txn call failed" err:context deadline exceeded 4999ms (15:45:50.553)] Trace[790366511]: [5.003451265s] [5.003451265s] END E0703 15:45:50.556721 1 timeout.go:142] post-timeout activity - time-elapsed: 3.103096ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0703 15:45:50.556784 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0703 15:45:50.557984 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:50.557998 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:50.558242 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0703 15:45:50.559625 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:50.559641 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:50.559762 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:50.560763 1 trace.go:236] Trace[656355783]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4d4836ea-26cb-4a3a-965b-de37d6ae5de9,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (03-Jul-2026 15:45:45.556) (total time: 5004ms): Trace[656355783]: [5.004125054s] [5.004125054s] END E0703 15:45:50.560818 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0703 15:45:50.560831 1 timeout.go:142] post-timeout activity - time-elapsed: 3.999951ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0703 15:45:50.560908 1 trace.go:236] Trace[1803481324]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2e88cb84-0431-46cd-949a-5940f1043cde,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (03-Jul-2026 15:45:45.557) (total time: 5003ms): Trace[1803481324]: [5.003131486s] [5.003131486s] END E0703 15:45:50.561105 1 timeout.go:142] post-timeout activity - time-elapsed: 2.904901ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0703 15:45:50.647494 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0703 15:45:50.647717 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0703 15:45:50.648908 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0703 15:45:50.648966 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0703 15:45:50.650138 1 trace.go:236] Trace[379112695]: "Get" accept:application/json, */*,audit-id:7ba782f0-e43c-4ce9-9d51-633bae88ae95,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:45.647) (total time: 5002ms): Trace[379112695]: [5.002457738s] [5.002457738s] END E0703 15:45:50.650318 1 timeout.go:142] post-timeout activity - time-elapsed: 2.770897ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0703 15:45:51.051295 1 trace.go:236] Trace[1987417575]: "Get" accept:application/json, */*,audit-id:97ce1029-2937-45e7-85ac-1f3e3c7fa746,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:45.557) (total time: 5494ms): Trace[1987417575]: ---"About to write a response" 5494ms (15:45:51.051) Trace[1987417575]: [5.494138034s] [5.494138034s] END I0703 15:45:51.052434 1 trace.go:236] Trace[676334964]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:22854bc1-d73e-4e64-bbae-128479995bac,client:199.204.45.248,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/data-ovn-ovsdb-sb-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (03-Jul-2026 15:45:50.055) (total time: 997ms): Trace[676334964]: ---"About to write a response" 997ms (15:45:51.052) Trace[676334964]: [997.080593ms] [997.080593ms] END I0703 15:45:51.052526 1 trace.go:236] Trace[322690653]: "Get" accept:application/json, */*,audit-id:1031f322-39f3-4a06-b002-bcb9e234ba9d,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:50.062) (total time: 989ms): Trace[322690653]: ---"About to write a response" 989ms (15:45:51.052) Trace[322690653]: [989.924454ms] [989.924454ms] END I0703 15:45:51.052799 1 trace.go:236] Trace[1139188313]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:11bc7df3-0172-40cb-b383-bf7fbe128e56,client:199.204.45.248,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (03-Jul-2026 15:45:50.055) (total time: 997ms): Trace[1139188313]: ["Create etcd3" audit-id:11bc7df3-0172-40cb-b383-bf7fbe128e56,key:/events/monitoring/node-feature-discovery-master-8665476dbc-46f4k.18bed22246006891,type:*core.Event,resource:events 982ms (15:45:50.070) Trace[1139188313]: ---"Txn call succeeded" 981ms (15:45:51.052)] Trace[1139188313]: [997.623308ms] [997.623308ms] END I0703 15:45:51.052995 1 trace.go:236] Trace[1607269347]: "Get" accept:application/json, */*,audit-id:747686a8-7164-4e47-8679-31b0455ac5ee,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:50.053) (total time: 999ms): Trace[1607269347]: ---"About to write a response" 999ms (15:45:51.052) Trace[1607269347]: [999.638224ms] [999.638224ms] END I0703 15:45:51.053040 1 trace.go:236] Trace[484613107]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:075f86bb-2893-41aa-b5b3-a25ce3be6480,client:199.204.45.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (03-Jul-2026 15:45:50.056) (total time: 996ms): Trace[484613107]: ["GuaranteedUpdate etcd3" audit-id:075f86bb-2893-41aa-b5b3-a25ce3be6480,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 995ms (15:45:50.057) Trace[484613107]: ---"Txn call completed" 995ms (15:45:51.052)] Trace[484613107]: [996.96264ms] [996.96264ms] END I0703 15:45:51.053154 1 trace.go:236] Trace[1630656235]: "Get" accept:application/json, */*,audit-id:16bbbbe3-f635-40fb-abea-2c1ac8109e9a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:45.558) (total time: 5494ms): Trace[1630656235]: ---"About to write a response" 5494ms (15:45:51.053) Trace[1630656235]: [5.494900245s] [5.494900245s] END I0703 15:45:51.053270 1 trace.go:236] Trace[1767028578]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:893aeda9-2b65-490d-967d-a7b80a500bac,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (03-Jul-2026 15:45:50.551) (total time: 501ms): Trace[1767028578]: ---"About to write a response" 501ms (15:45:51.053) Trace[1767028578]: [501.663663ms] [501.663663ms] END I0703 15:45:51.054093 1 trace.go:236] Trace[1434400047]: "Get" accept:application/json, */*,audit-id:7652da25-e8b7-46cd-af3a-c0c601cbf25d,client:199.204.45.248,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:50.052) (total time: 1001ms): Trace[1434400047]: ---"About to write a response" 1001ms (15:45:51.053) Trace[1434400047]: [1.001176386s] [1.001176386s] END I0703 15:45:51.056178 1 trace.go:236] Trace[1163210573]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d33f6852-80ac-4e01-a6f1-e4296b265442,client:10.0.0.206,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:50.052) (total time: 1003ms): Trace[1163210573]: ---"About to write a response" 1002ms (15:45:51.055) Trace[1163210573]: [1.003195353s] [1.003195353s] END I0703 15:45:51.057868 1 trace.go:236] Trace[1393340691]: "Get" accept:application/json, */*,audit-id:21d25a27-24a9-493a-94db-f2c7cb88ca9e,client:10.0.0.166,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-b47vv,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:45.599) (total time: 5458ms): Trace[1393340691]: ---"About to write a response" 5458ms (15:45:51.057) Trace[1393340691]: [5.458822776s] [5.458822776s] END I0703 15:45:51.057910 1 trace.go:236] Trace[1445329876]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b8943d70-2105-46d9-90b6-34874dca6390,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (03-Jul-2026 15:45:50.052) (total time: 1005ms): Trace[1445329876]: ["GuaranteedUpdate etcd3" audit-id:b8943d70-2105-46d9-90b6-34874dca6390,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 992ms (15:45:50.064) Trace[1445329876]: ---"Txn call completed" 985ms (15:45:51.051)] Trace[1445329876]: [1.005409254s] [1.005409254s] END I0703 15:45:51.146517 1 trace.go:236] Trace[546527506]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.248,type:*v1.Endpoints,resource:apiServerIPInfo (03-Jul-2026 15:45:50.052) (total time: 1093ms): Trace[546527506]: ---"initial value restored" 999ms (15:45:51.052) Trace[546527506]: ---"Txn call completed" 61ms (15:45:51.146) Trace[546527506]: [1.093539517s] [1.093539517s] END I0703 15:45:55.798513 1 trace.go:236] Trace[1150571031]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:34601fe1-5d29-430f-8afc-23b5a42ab7f4,client:10.0.0.206,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (03-Jul-2026 15:45:55.249) (total time: 548ms): Trace[1150571031]: ["GuaranteedUpdate etcd3" audit-id:34601fe1-5d29-430f-8afc-23b5a42ab7f4,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 548ms (15:45:55.249) Trace[1150571031]: ---"Txn call completed" 547ms (15:45:55.798)] Trace[1150571031]: [548.690588ms] [548.690588ms] END I0703 15:45:55.798579 1 trace.go:236] Trace[84737222]: "Get" accept:application/json, */*,audit-id:f353e113-ccdd-4fa1-aa28-2e039494abec,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:55.250) (total time: 548ms): Trace[84737222]: ---"About to write a response" 548ms (15:45:55.798) Trace[84737222]: [548.377629ms] [548.377629ms] END I0703 15:45:55.798672 1 trace.go:236] Trace[1952768932]: "Get" accept:application/json, */*,audit-id:cee740fb-b2fd-4bad-abc1-feaf4702c275,client:10.0.0.166,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-b47vv,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (03-Jul-2026 15:45:55.269) (total time: 528ms): Trace[1952768932]: ---"About to write a response" 527ms (15:45:55.797) Trace[1952768932]: [528.631982ms] [528.631982ms] END