I0309 01:39:11.160912 1 options.go:220] external host was not specified, using 199.204.45.144 I0309 01:39:11.161814 1 server.go:148] Version: v1.28.13 I0309 01:39:11.161853 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0309 01:39:11.534123 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0309 01:39:11.545455 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0309 01:39:11.545475 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0309 01:39:11.545670 1 instance.go:298] Using reconciler: lease I0309 01:39:11.684674 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0309 01:39:11.684715 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0309 01:39:11.922971 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0309 01:39:11.923175 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0309 01:39:12.407517 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0309 01:39:12.427324 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0309 01:39:12.427352 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.427358 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.427702 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0309 01:39:12.427714 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0309 01:39:12.428397 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0309 01:39:12.429002 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0309 01:39:12.429014 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0309 01:39:12.429019 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0309 01:39:12.430202 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0309 01:39:12.430216 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0309 01:39:12.430952 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0309 01:39:12.430965 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.430979 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.431471 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0309 01:39:12.431483 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.431515 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0309 01:39:12.431935 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0309 01:39:12.433379 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0309 01:39:12.433393 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.433396 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.433724 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0309 01:39:12.433736 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.433739 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.434360 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0309 01:39:12.434372 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0309 01:39:12.435809 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0309 01:39:12.435823 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.435827 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.436197 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0309 01:39:12.436212 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.436215 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.437851 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0309 01:39:12.437865 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.437869 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.438840 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0309 01:39:12.439695 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0309 01:39:12.439708 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.439712 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.443283 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0309 01:39:12.443307 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0309 01:39:12.443314 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0309 01:39:12.444294 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0309 01:39:12.444311 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0309 01:39:12.444316 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0309 01:39:12.444875 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0309 01:39:12.444890 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0309 01:39:12.476733 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0309 01:39:12.476768 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0309 01:39:12.853022 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0309 01:39:12.853109 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0309 01:39:12.853113 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0309 01:39:12.853570 1 secure_serving.go:213] Serving securely on [::]:6443 I0309 01:39:12.853695 1 aggregator.go:164] waiting for initial CRD sync... I0309 01:39:12.853754 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0309 01:39:12.853805 1 controller.go:78] Starting OpenAPI AggregationController I0309 01:39:12.853888 1 system_namespaces_controller.go:67] Starting system namespaces controller I0309 01:39:12.853904 1 available_controller.go:423] Starting AvailableConditionController I0309 01:39:12.853966 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0309 01:39:12.853905 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0309 01:39:12.854062 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0309 01:39:12.854029 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0309 01:39:12.854093 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0309 01:39:12.854118 1 controller.go:80] Starting OpenAPI V3 AggregationController I0309 01:39:12.854215 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0309 01:39:12.854242 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0309 01:39:12.854263 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0309 01:39:12.854286 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0309 01:39:12.854121 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0309 01:39:12.854379 1 gc_controller.go:78] Starting apiserver lease garbage collector I0309 01:39:12.854444 1 gc_controller.go:78] Starting apiserver lease garbage collector I0309 01:39:12.854648 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0309 01:39:12.854789 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0309 01:39:12.868951 1 controller.go:134] Starting OpenAPI controller I0309 01:39:12.869007 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0309 01:39:12.869029 1 controller.go:85] Starting OpenAPI V3 controller I0309 01:39:12.869054 1 naming_controller.go:291] Starting NamingConditionController I0309 01:39:12.869073 1 establishing_controller.go:76] Starting EstablishingController I0309 01:39:12.869084 1 controller.go:116] Starting legacy_token_tracking_controller I0309 01:39:12.869092 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0309 01:39:12.869095 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0309 01:39:12.869110 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0309 01:39:12.869144 1 crd_finalizer.go:266] Starting CRDFinalizer I0309 01:39:12.934824 1 shared_informer.go:318] Caches are synced for node_authorizer I0309 01:39:12.954706 1 apf_controller.go:379] Running API Priority and Fairness config worker I0309 01:39:12.954731 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0309 01:39:12.954786 1 cache.go:39] Caches are synced for AvailableConditionController controller I0309 01:39:12.954831 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0309 01:39:12.954849 1 shared_informer.go:318] Caches are synced for crd-autoregister I0309 01:39:12.954876 1 aggregator.go:166] initial CRD sync complete... I0309 01:39:12.954892 1 autoregister_controller.go:141] Starting autoregister controller I0309 01:39:12.954900 1 cache.go:32] Waiting for caches to sync for autoregister controller I0309 01:39:12.954908 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0309 01:39:12.954913 1 cache.go:39] Caches are synced for autoregister controller I0309 01:39:12.956559 1 controller.go:624] quota admission added evaluator for: namespaces I0309 01:39:12.969667 1 shared_informer.go:318] Caches are synced for configmaps I0309 01:39:13.017192 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0309 01:39:13.860377 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0309 01:39:13.865219 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0309 01:39:13.865242 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0309 01:39:14.414740 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0309 01:39:14.459472 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0309 01:39:14.573829 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0309 01:39:14.581161 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.144] I0309 01:39:14.582685 1 controller.go:624] quota admission added evaluator for: endpoints I0309 01:39:14.591786 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0309 01:39:16.049792 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0309 01:39:16.058340 1 controller.go:624] quota admission added evaluator for: deployments.apps I0309 01:39:16.144353 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0309 01:39:16.350473 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0309 01:39:21.840969 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0309 01:39:22.089571 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0309 01:39:47.953542 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0309 01:39:47.973007 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0309 01:39:47.988896 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0309 01:39:47.996497 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.96.112.137"} I0309 01:39:48.008394 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.110.109.137"} I0309 01:39:48.018812 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0309 01:39:48.075884 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0309 01:39:48.103451 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0309 01:39:48.581352 1 controller.go:624] quota admission added evaluator for: jobs.batch I0309 01:39:56.147897 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0309 01:39:56.168175 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0309 01:39:56.178461 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0309 01:39:56.745274 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0309 01:39:56.951110 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0309 01:39:57.153055 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0309 01:39:57.352988 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0309 01:39:57.965615 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0309 01:39:58.174154 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0309 01:39:59.594282 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0309 01:39:59.970969 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0309 01:40:04.262708 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io W0309 01:40:16.611291 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.96.112.137:443: connect: connection refused I0309 01:40:21.603387 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0309 01:40:27.258600 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0309 01:40:40.627615 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.108.0.1"} I0309 01:40:40.635504 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.96.21.89"} I0309 01:40:40.643834 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.104.92.96"} I0309 01:40:40.649894 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.111.40.225"} I0309 01:40:47.152842 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.172188 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.193650 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.213002 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.240827 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.270278 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.294320 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.320998 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.344392 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.363278 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0309 01:40:47.386036 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.411399 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:47.425211 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:48.630915 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0309 01:40:51.574538 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0309 01:40:51.630265 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.101.6.167"} I0309 01:40:51.655510 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0309 01:40:53.968629 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0309 01:40:53.994768 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0309 01:40:54.590469 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0309 01:40:54.590511 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0309 01:40:54.590542 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0309 01:41:00.309441 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0309 01:41:03.930709 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.99.84.14"} I0309 01:41:04.197027 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0309 01:41:04.318754 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0309 01:41:04.457326 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.110.113.71"} I0309 01:41:04.469106 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.98.209.203"} I0309 01:41:07.456421 1 trace.go:236] Trace[369759929]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c1becf1f-4b86-47dd-a494-e43fddc23cf0,client:199.204.45.144,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/openstack/endpointslices/percona-xtradb-haproxy-j225s,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (09-Mar-2026 01:41:06.869) (total time: 586ms): Trace[369759929]: ["GuaranteedUpdate etcd3" audit-id:c1becf1f-4b86-47dd-a494-e43fddc23cf0,key:/endpointslices/openstack/percona-xtradb-haproxy-j225s,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 586ms (01:41:06.869) Trace[369759929]: ---"Txn call completed" 585ms (01:41:07.456)] Trace[369759929]: [586.742744ms] [586.742744ms] END I0309 01:41:07.501519 1 trace.go:236] Trace[1245688051]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:54eea7d3-e6a1-407d-9431-d4988b511b03,client:199.204.45.144,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/openstack/endpointslices/percona-xtradb-haproxy-replicas-qzjnv,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (09-Mar-2026 01:41:06.869) (total time: 631ms): Trace[1245688051]: ["GuaranteedUpdate etcd3" audit-id:54eea7d3-e6a1-407d-9431-d4988b511b03,key:/endpointslices/openstack/percona-xtradb-haproxy-replicas-qzjnv,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 631ms (01:41:06.869) Trace[1245688051]: ---"Txn call completed" 630ms (01:41:07.501)] Trace[1245688051]: [631.610982ms] [631.610982ms] END I0309 01:41:07.502012 1 trace.go:236] Trace[967127881]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2c370a88-1f7b-4c7e-b53b-ebdaa3d16637,client:199.204.45.144,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/percona-xtradb-haproxy-replicas,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpoint-controller,verb:PUT (09-Mar-2026 01:41:06.869) (total time: 632ms): Trace[967127881]: ["GuaranteedUpdate etcd3" audit-id:2c370a88-1f7b-4c7e-b53b-ebdaa3d16637,key:/services/endpoints/openstack/percona-xtradb-haproxy-replicas,type:*core.Endpoints,resource:endpoints 631ms (01:41:06.870) Trace[967127881]: ---"Txn call completed" 630ms (01:41:07.501)] Trace[967127881]: [632.112025ms] [632.112025ms] END I0309 01:41:07.502181 1 trace.go:236] Trace[469647585]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6dc45409-912f-4505-ac3b-c275db06a10e,client:199.204.45.144,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/percona-xtradb-haproxy,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpoint-controller,verb:PUT (09-Mar-2026 01:41:06.869) (total time: 632ms): Trace[469647585]: ["GuaranteedUpdate etcd3" audit-id:6dc45409-912f-4505-ac3b-c275db06a10e,key:/services/endpoints/openstack/percona-xtradb-haproxy,type:*core.Endpoints,resource:endpoints 632ms (01:41:06.869) Trace[469647585]: ---"Txn call completed" 630ms (01:41:07.501)] Trace[469647585]: [632.512686ms] [632.512686ms] END I0309 01:42:23.745707 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.107.43.101"} I0309 01:42:26.175984 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.101.212.166"} I0309 01:42:26.185301 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.104.71.19"} I0309 01:42:32.615397 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.111.84.194"} I0309 01:42:32.625431 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.97.38.129"} I0309 01:44:56.405332 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0309 01:45:00.180317 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0309 01:45:00.214187 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0309 01:45:03.514731 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0309 01:45:03.531014 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0309 01:45:03.556402 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0309 01:45:03.565995 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0309 01:45:03.575558 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0309 01:45:03.584111 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0309 01:45:03.593042 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0309 01:45:05.687881 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0309 01:45:14.869360 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0309 01:45:53.763307 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0309 01:46:07.866874 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0309 01:46:08.033437 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0309 01:46:08.083917 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0309 01:46:08.354349 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0309 01:46:08.594606 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0309 01:46:08.607224 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0309 01:46:08.715719 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0309 01:46:08.746867 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0309 01:46:08.842385 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0309 01:46:46.425957 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.97.69.79"} I0309 01:46:46.431967 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.96.247.208"} I0309 01:46:46.440211 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.98.192.10"} I0309 01:46:46.448808 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.111.182.77"} I0309 01:46:46.455771 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.110.98.71"} I0309 01:46:46.464557 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.106.59.224"} I0309 01:46:46.506145 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0309 01:46:46.530430 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0309 01:46:46.581102 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0309 01:46:46.600735 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0309 01:46:46.622796 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0309 01:46:46.632322 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.632353 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.632426 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.632461 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.632577 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.632610 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.632653 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.632687 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.632661 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.632707 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.632869 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.632919 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.632826 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.633278 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.633586 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.633621 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.633641 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.633623 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.633741 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.633784 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.633699 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.633804 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.634330 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.634370 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.634444 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.634478 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.635386 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.635414 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.635410 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.635438 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused W0309 01:46:46.636581 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused E0309 01:46:46.636626 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.98.71:443: connect: connection refused I0309 01:46:56.647987 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.108.145.176"} I0309 01:46:56.658331 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.97.168.122"} I0309 01:47:00.534532 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.100.37.87"} I0309 01:47:03.226901 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.103.190.128"} I0309 01:47:08.607077 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.99.241.133"} I0309 01:47:09.506846 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.97.117.11"} I0309 01:47:16.267493 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0309 01:47:16.422043 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.100.226.158"} E0309 01:47:53.583398 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.204.45.144:52174->199.204.45.144:10250: write: connection reset by peer I0309 01:48:06.203135 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.104.88.32"} I0309 01:48:06.217242 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0309 01:51:09.273472 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.110.85.73"} I0309 01:51:37.191718 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.104.92.8"} I0309 01:53:18.972145 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0309 01:53:19.002587 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.005611 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.012750 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.030512 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.066604 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.100964 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.110646 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.121870 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0309 01:53:19.129773 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.137256 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.151060 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.178524 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.190095 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.203638 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.226442 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.276425 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.316007 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:19.423141 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0309 01:53:58.708274 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0309 01:53:58.720570 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0309 01:54:31.073519 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.100.141.121"} I0309 01:54:31.756170 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.108.110.156"} I0309 01:54:59.681009 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.111.53.204"} I0309 01:57:37.656401 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.102.209.10"}