I0428 03:23:03.771660 1 options.go:220] external host was not specified, using 199.19.213.142 I0428 03:23:03.772522 1 server.go:148] Version: v1.28.13 I0428 03:23:03.772583 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0428 03:23:04.093189 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0428 03:23:04.109345 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0428 03:23:04.109380 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0428 03:23:04.109666 1 instance.go:298] Using reconciler: lease I0428 03:23:04.617871 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0428 03:23:04.617894 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0428 03:23:04.883158 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0428 03:23:04.883392 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0428 03:23:05.375324 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0428 03:23:05.388413 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0428 03:23:05.388461 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.388473 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.389123 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0428 03:23:05.389138 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0428 03:23:05.389850 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0428 03:23:05.390509 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0428 03:23:05.390524 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0428 03:23:05.390528 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0428 03:23:05.392051 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0428 03:23:05.392067 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0428 03:23:05.392809 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0428 03:23:05.392824 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.392832 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.394089 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0428 03:23:05.394122 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.394290 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0428 03:23:05.395240 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0428 03:23:05.397989 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0428 03:23:05.398017 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.398025 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.398841 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0428 03:23:05.398863 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.398871 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.400273 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0428 03:23:05.400297 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0428 03:23:05.403113 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0428 03:23:05.403139 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.403148 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.404000 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0428 03:23:05.404029 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.404036 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.406030 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0428 03:23:05.406042 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.406045 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.407041 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0428 03:23:05.408216 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0428 03:23:05.408229 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.408232 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.419760 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0428 03:23:05.419800 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0428 03:23:05.419810 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0428 03:23:05.421122 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0428 03:23:05.421137 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0428 03:23:05.421142 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0428 03:23:05.421707 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0428 03:23:05.421719 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0428 03:23:05.456164 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0428 03:23:05.456203 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0428 03:23:05.835640 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0428 03:23:05.835666 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0428 03:23:05.835815 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0428 03:23:05.836014 1 secure_serving.go:213] Serving securely on [::]:6443 I0428 03:23:05.836126 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0428 03:23:05.836120 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0428 03:23:05.836156 1 available_controller.go:423] Starting AvailableConditionController I0428 03:23:05.836161 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0428 03:23:05.836141 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0428 03:23:05.836324 1 controller.go:78] Starting OpenAPI AggregationController I0428 03:23:05.836348 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0428 03:23:05.836408 1 aggregator.go:164] waiting for initial CRD sync... I0428 03:23:05.836456 1 system_namespaces_controller.go:67] Starting system namespaces controller I0428 03:23:05.836475 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0428 03:23:05.836490 1 gc_controller.go:78] Starting apiserver lease garbage collector I0428 03:23:05.836611 1 controller.go:80] Starting OpenAPI V3 AggregationController I0428 03:23:05.836666 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0428 03:23:05.836835 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0428 03:23:05.836853 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0428 03:23:05.836903 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0428 03:23:05.836997 1 controller.go:134] Starting OpenAPI controller I0428 03:23:05.836868 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0428 03:23:05.837048 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0428 03:23:05.837099 1 naming_controller.go:291] Starting NamingConditionController I0428 03:23:05.837143 1 establishing_controller.go:76] Starting EstablishingController I0428 03:23:05.837181 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0428 03:23:05.836720 1 gc_controller.go:78] Starting apiserver lease garbage collector I0428 03:23:05.837216 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0428 03:23:05.837251 1 crd_finalizer.go:266] Starting CRDFinalizer I0428 03:23:05.837061 1 controller.go:85] Starting OpenAPI V3 controller I0428 03:23:05.836753 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0428 03:23:05.837618 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0428 03:23:05.837667 1 controller.go:116] Starting legacy_token_tracking_controller I0428 03:23:05.837752 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0428 03:23:05.893558 1 shared_informer.go:318] Caches are synced for node_authorizer E0428 03:23:05.909396 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0428 03:23:05.936977 1 cache.go:39] Caches are synced for AvailableConditionController controller I0428 03:23:05.937122 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0428 03:23:05.937176 1 apf_controller.go:379] Running API Priority and Fairness config worker I0428 03:23:05.937213 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0428 03:23:05.937385 1 shared_informer.go:318] Caches are synced for crd-autoregister I0428 03:23:05.937472 1 aggregator.go:166] initial CRD sync complete... I0428 03:23:05.937500 1 autoregister_controller.go:141] Starting autoregister controller I0428 03:23:05.937513 1 cache.go:32] Waiting for caches to sync for autoregister controller I0428 03:23:05.937529 1 cache.go:39] Caches are synced for autoregister controller I0428 03:23:05.937834 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0428 03:23:05.937854 1 shared_informer.go:318] Caches are synced for configmaps I0428 03:23:05.939157 1 controller.go:624] quota admission added evaluator for: namespaces I0428 03:23:06.114965 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0428 03:23:06.845147 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0428 03:23:06.849836 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0428 03:23:06.849850 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0428 03:23:07.459832 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0428 03:23:07.515029 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0428 03:23:07.653685 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0428 03:23:07.662948 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.142] I0428 03:23:07.664531 1 controller.go:624] quota admission added evaluator for: endpoints I0428 03:23:07.670898 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0428 03:23:09.081920 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0428 03:23:09.094268 1 controller.go:624] quota admission added evaluator for: deployments.apps I0428 03:23:09.138819 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0428 03:23:09.348440 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0428 03:23:15.112522 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0428 03:23:15.408850 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0428 03:23:34.213973 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 03:23:34.223086 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:23:34.232998 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:23:34.233048 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:23:34.270389 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 03:23:34.289205 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 03:23:34.310039 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 03:23:34.327717 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 03:23:34.347590 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:23:34.347636 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0428 03:23:34.382443 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 03:23:34.382498 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0428 03:23:34.440301 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:23:34.440376 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:23:34.488742 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:23:34.582266 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:34.765646 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:23:34.765749 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:23:34.809217 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:34.837499 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:34.881529 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:34.897278 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:35.727489 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:35.729488 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:35.835137 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:23:41.377106 1 controller.go:624] quota admission added evaluator for: jobs.batch I0428 03:23:42.144311 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:23:42.152174 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:23:42.350854 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:23:42.547433 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:23:42.755860 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:23:42.955277 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:23:43.150515 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:23:43.566767 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:23:46.105137 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:23:46.207000 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:23:46.286142 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0428 03:23:47.077364 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0428 03:23:47.077408 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0428 03:23:50.089794 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0428 03:23:58.492299 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.111.127.162"} W0428 03:23:58.524602 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.111.127.162:9443: connect: connection refused E0428 03:23:58.524635 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.111.127.162:9443: connect: connection refused I0428 03:24:10.703006 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0428 03:24:10.716656 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0428 03:24:10.730141 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0428 03:24:10.780432 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.106.14.121"} I0428 03:24:10.792782 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.111.55.210"} I0428 03:24:10.801090 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0428 03:24:10.835879 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0428 03:24:10.863370 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0428 03:24:21.313986 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0428 03:24:27.406990 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0428 03:24:38.756263 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.109.155.219"} I0428 03:24:38.766174 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.103.143.56"} I0428 03:24:38.777693 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.103.63.27"} I0428 03:24:38.785046 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.103.46.16"} I0428 03:24:45.306832 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.328572 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.350859 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.369123 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.394064 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.415314 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.444459 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.464633 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.488713 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.508372 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0428 03:24:45.531959 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.559896 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:45.580840 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:47.027609 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0428 03:24:50.372238 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0428 03:24:50.428776 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.98.52.114"} I0428 03:24:50.460045 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0428 03:24:52.648022 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0428 03:24:52.690080 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0428 03:24:53.310431 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0428 03:24:53.310486 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0428 03:24:53.310534 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0428 03:25:00.056553 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0428 03:25:02.878026 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.98.237.243"} I0428 03:25:03.153767 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0428 03:25:03.312426 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.100.234.133"} I0428 03:25:03.331535 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.99.48.32"} I0428 03:25:03.636520 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0428 03:26:22.377976 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.110.14.170"} I0428 03:26:24.868786 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.106.219.97"} I0428 03:26:24.875709 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.110.152.54"} I0428 03:26:31.377567 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.100.228.251"} I0428 03:26:31.390364 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.109.75.143"} I0428 03:29:01.183280 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0428 03:29:05.226674 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0428 03:29:05.263561 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0428 03:29:09.060123 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0428 03:29:09.074686 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0428 03:29:09.087887 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0428 03:29:09.100542 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0428 03:29:09.112142 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0428 03:29:09.127840 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0428 03:29:09.137581 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0428 03:29:10.976815 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0428 03:29:22.877978 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0428 03:30:02.344657 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0428 03:30:16.599024 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0428 03:30:16.775871 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0428 03:30:16.832082 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0428 03:30:17.070842 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0428 03:30:17.294440 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0428 03:30:17.312349 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0428 03:30:17.376008 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0428 03:30:17.401395 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0428 03:30:17.520285 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0428 03:30:56.631817 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.103.210.86"} I0428 03:30:56.639951 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.110.213.184"} I0428 03:30:56.650633 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.106.64.83"} I0428 03:30:56.657179 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.106.18.25"} I0428 03:30:56.667439 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.109.32.0"} I0428 03:30:56.678243 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.101.181.99"} I0428 03:30:56.726279 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0428 03:30:56.746861 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0428 03:30:56.811063 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0428 03:30:56.820218 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0428 03:30:56.844466 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0428 03:30:56.863050 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863085 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863134 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863167 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863261 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863289 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863287 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863345 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863392 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863464 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863502 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863471 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863555 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863593 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863608 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863620 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863639 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863646 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.863863 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.863889 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.864160 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.864185 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.864397 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.864414 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.864427 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.864441 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.866068 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.866103 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.866648 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.866677 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused W0428 03:30:56.866857 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused E0428 03:30:56.866941 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.210.86:443: connect: connection refused I0428 03:31:07.245335 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.106.57.85"} I0428 03:31:07.255008 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.109.85.66"} I0428 03:31:12.028487 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.96.30.93"} I0428 03:31:15.127918 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.105.211.99"} I0428 03:31:19.515650 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.111.198.25"} I0428 03:31:20.583691 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.105.202.100"} I0428 03:31:27.118958 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0428 03:31:27.272214 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.108.0.151"} I0428 03:32:17.879304 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.104.222.255"} I0428 03:32:17.896124 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0428 03:35:18.870068 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.100.223.125"} I0428 03:35:52.528120 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.104.100.86"} I0428 03:37:42.352891 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0428 03:37:42.369614 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0428 03:37:42.370152 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.400857 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.411355 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.421975 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.431341 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.439595 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.456937 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.469343 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.492375 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.503226 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.521986 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.542784 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.573110 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.605104 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.650980 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:37:42.792513 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0428 03:38:02.163063 1 trace.go:236] Trace[60472619]: "Update" accept:application/json, */*,audit-id:fc964689-30e2-4dc6-bdb2-d3a538be8bc3,client:10.0.0.172,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 03:38:00.873) (total time: 1289ms): Trace[60472619]: ["GuaranteedUpdate etcd3" audit-id:fc964689-30e2-4dc6-bdb2-d3a538be8bc3,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1289ms (03:38:00.873) Trace[60472619]: ---"Txn call completed" 1287ms (03:38:02.162)] Trace[60472619]: [1.289307879s] [1.289307879s] END I0428 03:38:02.164502 1 trace.go:236] Trace[1709021566]: "Update" accept:application/json, */*,audit-id:43d0a147-a3cd-42c5-afe9-3247b09e21d3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Apr-2026 03:38:00.873) (total time: 1291ms): Trace[1709021566]: ["GuaranteedUpdate etcd3" audit-id:43d0a147-a3cd-42c5-afe9-3247b09e21d3,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1290ms (03:38:00.873) Trace[1709021566]: ---"Txn call completed" 1289ms (03:38:02.164)] Trace[1709021566]: [1.291197114s] [1.291197114s] END I0428 03:38:02.165068 1 trace.go:236] Trace[1133435547]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:70145feb-21d5-458f-9f83-59c93f778f30,client:199.19.213.142,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (28-Apr-2026 03:38:00.872) (total time: 1292ms): Trace[1133435547]: ["GuaranteedUpdate etcd3" audit-id:70145feb-21d5-458f-9f83-59c93f778f30,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1292ms (03:38:00.872) Trace[1133435547]: ---"Txn call completed" 1288ms (03:38:02.162)] Trace[1133435547]: [1.292347202s] [1.292347202s] END I0428 03:38:02.167277 1 trace.go:236] Trace[238235149]: "Get" accept:application/json, */*,audit-id:dfbb35c4-47f8-4f1e-8e90-374b42d5cf5d,client:10.0.0.114,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (28-Apr-2026 03:38:00.873) (total time: 1293ms): Trace[238235149]: ---"About to write a response" 1289ms (03:38:02.163) Trace[238235149]: [1.2939083s] [1.2939083s] END I0428 03:38:02.995185 1 trace.go:236] Trace[1554821245]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ccb8d75a-1f38-4126-ae9d-4cbcddfc9618,client:10.0.0.229,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 03:38:01.494) (total time: 1500ms): Trace[1554821245]: ["GuaranteedUpdate etcd3" audit-id:ccb8d75a-1f38-4126-ae9d-4cbcddfc9618,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1500ms (03:38:01.494) Trace[1554821245]: ---"Txn call completed" 1499ms (03:38:02.994)] Trace[1554821245]: [1.500384305s] [1.500384305s] END I0428 03:38:02.995938 1 trace.go:236] Trace[841205968]: "Update" accept:application/json, */*,audit-id:5f2b284c-f8d0-4104-a059-7ddfe345ac34,client:10.0.0.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 03:38:01.494) (total time: 1501ms): Trace[841205968]: ["GuaranteedUpdate etcd3" audit-id:5f2b284c-f8d0-4104-a059-7ddfe345ac34,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1501ms (03:38:01.494) Trace[841205968]: ---"Txn call completed" 1500ms (03:38:02.995)] Trace[841205968]: [1.501590175s] [1.501590175s] END I0428 03:38:03.550078 1 trace.go:236] Trace[262193281]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bffef8f5-128b-47a3-84ff-e874dfdaadd7,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 03:38:01.787) (total time: 1762ms): Trace[262193281]: ["GuaranteedUpdate etcd3" audit-id:bffef8f5-128b-47a3-84ff-e874dfdaadd7,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1762ms (03:38:01.787) Trace[262193281]: ---"Txn call completed" 1760ms (03:38:03.549)] Trace[262193281]: [1.762362846s] [1.762362846s] END I0428 03:38:03.617978 1 trace.go:236] Trace[1310684328]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ebb13528-e335-4aad-96ca-ff05b5b169ec,client:199.19.213.142,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Apr-2026 03:38:01.860) (total time: 1756ms): Trace[1310684328]: ---"About to write a response" 1756ms (03:38:03.617) Trace[1310684328]: [1.756966697s] [1.756966697s] END I0428 03:38:03.617983 1 trace.go:236] Trace[1635607033]: "Get" accept:application/json, */*,audit-id:0aa369d9-db4f-442f-bb34-81937c1c7e28,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:38:02.873) (total time: 744ms): Trace[1635607033]: ---"About to write a response" 743ms (03:38:03.617) Trace[1635607033]: [744.067265ms] [744.067265ms] END I0428 03:38:03.618283 1 trace.go:236] Trace[203615541]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0bbcdf6e-84b5-4319-97f0-a418ca5dfe76,client:199.19.213.142,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Apr-2026 03:38:02.184) (total time: 1433ms): Trace[203615541]: ---"About to write a response" 1433ms (03:38:03.618) Trace[203615541]: [1.433919408s] [1.433919408s] END I0428 03:38:03.618295 1 trace.go:236] Trace[2087579914]: "Get" accept:application/json, */*,audit-id:ed8b30f6-1bff-4c9b-8fa2-7b4ac41dd569,client:199.19.213.142,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Apr-2026 03:38:01.416) (total time: 2201ms): Trace[2087579914]: ---"About to write a response" 2201ms (03:38:03.618) Trace[2087579914]: [2.201479761s] [2.201479761s] END I0428 03:38:03.618295 1 trace.go:236] Trace[1579537400]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7e60de2e-e2a3-4795-a282-82d956664bd1,client:199.19.213.142,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Apr-2026 03:38:01.054) (total time: 2563ms): Trace[1579537400]: ---"About to write a response" 2563ms (03:38:03.618) Trace[1579537400]: [2.563368579s] [2.563368579s] END I0428 03:38:03.618455 1 trace.go:236] Trace[2137107976]: "Get" accept:application/json, */*,audit-id:db751642-baf4-4563-863a-90377c3b609f,client:10.0.0.150,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (28-Apr-2026 03:38:00.966) (total time: 2652ms): Trace[2137107976]: ---"About to write a response" 2652ms (03:38:03.618) Trace[2137107976]: [2.652345981s] [2.652345981s] END I0428 03:38:03.618893 1 trace.go:236] Trace[6903118]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bf8f348f-d245-4715-b9b2-2a218d7e9c9a,client:10.0.0.114,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments/percona-xtradb-pitr,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (28-Apr-2026 03:38:02.244) (total time: 1374ms): Trace[6903118]: [1.374206844s] [1.374206844s] END I0428 03:38:03.619761 1 trace.go:236] Trace[2010022856]: "Get" accept:application/json, */*,audit-id:5f158524-3444-4ddd-991e-14c5d45d1951,client:199.19.213.142,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-6j4m4,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:38:00.890) (total time: 2729ms): Trace[2010022856]: ---"About to write a response" 2729ms (03:38:03.619) Trace[2010022856]: [2.729587011s] [2.729587011s] END I0428 03:38:03.635133 1 trace.go:236] Trace[2046543455]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8ea639f6-380e-4cfc-b4ef-3cf89c59fc76,client:199.19.213.142,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/barbican-api-6bd9fcc85c-95gbj.18aa6819c845316d,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Apr-2026 03:38:02.896) (total time: 738ms): Trace[2046543455]: ["GuaranteedUpdate etcd3" audit-id:8ea639f6-380e-4cfc-b4ef-3cf89c59fc76,key:/events/openstack/barbican-api-6bd9fcc85c-95gbj.18aa6819c845316d,type:*core.Event,resource:events 738ms (03:38:02.896) Trace[2046543455]: ---"initial value restored" 721ms (03:38:03.618)] Trace[2046543455]: ---"Object stored in database" 15ms (03:38:03.635) Trace[2046543455]: [738.311806ms] [738.311806ms] END I0428 03:38:27.411659 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0428 03:38:27.423327 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0428 03:39:01.682975 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.109.157.127"} I0428 03:39:02.831465 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.106.38.19"} E0428 03:39:29.200817 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.19.213.142:50008->199.19.213.142:10250: write: connection reset by peer I0428 03:39:36.567839 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.98.118.87"} I0428 03:42:12.394176 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.97.165.191"} I0428 03:42:34.892794 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-cinder" clusterIPs={"IPv4":"10.108.93.32"} I0428 03:43:09.156598 1 alloc.go:330] "allocated clusterIPs" service="openstack/cinder-api" clusterIPs={"IPv4":"10.97.114.41"} I0428 03:47:53.597213 1 alloc.go:330] "allocated clusterIPs" service="openstack/placement-api" clusterIPs={"IPv4":"10.102.216.186"} I0428 03:50:07.299953 1 alloc.go:330] "allocated clusterIPs" service="openstack/ovn-ovsdb-sb" clusterIPs={"IPv4":"10.99.138.4"} I0428 03:50:07.305408 1 alloc.go:330] "allocated clusterIPs" service="openstack/ovn-ovsdb-nb" clusterIPs={"IPv4":"10.104.106.21"} I0428 03:50:21.571307 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-nova" clusterIPs={"IPv4":"10.104.156.9"} E0428 03:50:47.960449 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.19.213.142:49176->199.19.213.142:10250: write: broken pipe I0428 03:50:59.374729 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-metadata" clusterIPs={"IPv4":"10.98.251.84"} I0428 03:50:59.387900 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-novncproxy" clusterIPs={"IPv4":"10.111.107.159"} I0428 03:50:59.400930 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-api" clusterIPs={"IPv4":"10.110.148.227"} I0428 03:53:55.474325 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-neutron" clusterIPs={"IPv4":"10.110.27.111"} I0428 03:54:29.897486 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-server" clusterIPs={"IPv4":"10.103.9.156"} I0428 03:57:02.415946 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-heat" clusterIPs={"IPv4":"10.98.35.103"} I0428 03:57:36.603528 1 alloc.go:330] "allocated clusterIPs" service="openstack/heat-api" clusterIPs={"IPv4":"10.107.182.55"} I0428 03:57:36.610160 1 alloc.go:330] "allocated clusterIPs" service="openstack/heat-cfn" clusterIPs={"IPv4":"10.98.51.160"} I0428 04:00:47.991194 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-octavia" clusterIPs={"IPv4":"10.98.243.157"} I0428 04:02:32.667485 1 controller.go:624] quota admission added evaluator for: sshkeys.secretgen.k14s.io I0428 04:02:45.291423 1 alloc.go:330] "allocated clusterIPs" service="openstack/octavia-api" clusterIPs={"IPv4":"10.98.140.214"} I0428 04:04:56.169606 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-magnum" clusterIPs={"IPv4":"10.104.179.222"} I0428 04:05:34.182390 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.212474 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.235698 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.266736 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.292024 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.339473 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.362511 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.411052 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.424224 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.468174 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.519471 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.538442 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.564297 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.580229 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.620883 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.665459 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.685356 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.737162 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.762258 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.808503 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.841935 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.865482 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.908051 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:34.929854 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0428 04:05:35.066882 1 alloc.go:330] "allocated clusterIPs" service="orc-system/orc-controller-manager-metrics-service" clusterIPs={"IPv4":"10.96.225.191"} I0428 04:05:38.845552 1 handler.go:275] Adding GroupVersion clusterctl.cluster.x-k8s.io v1alpha3 to ResourceManager I0428 04:05:40.360441 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.367262 1 handler.go:275] Adding GroupVersion addons.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.381653 1 handler.go:275] Adding GroupVersion addons.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.423104 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.437760 1 handler.go:275] Adding GroupVersion runtime.cluster.x-k8s.io v1alpha1 to ResourceManager I0428 04:05:40.442749 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1alpha1 to ResourceManager I0428 04:05:40.442785 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.451449 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1alpha1 to ResourceManager I0428 04:05:40.451542 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.518376 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.529107 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.561284 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.603849 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.647935 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.684355 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:40.771695 1 alloc.go:330] "allocated clusterIPs" service="capi-system/capi-webhook-service" clusterIPs={"IPv4":"10.107.214.212"} I0428 04:05:40.867039 1 controller.go:624] quota admission added evaluator for: providers.clusterctl.cluster.x-k8s.io I0428 04:05:41.116103 1 handler.go:275] Adding GroupVersion bootstrap.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:41.192298 1 handler.go:275] Adding GroupVersion bootstrap.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:41.218006 1 alloc.go:330] "allocated clusterIPs" service="capi-kubeadm-bootstrap-system/capi-kubeadm-bootstrap-webhook-service" clusterIPs={"IPv4":"10.108.143.217"} I0428 04:05:41.700873 1 handler.go:275] Adding GroupVersion controlplane.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:41.734861 1 alloc.go:330] "allocated clusterIPs" service="capi-kubeadm-control-plane-system/capi-kubeadm-control-plane-webhook-service" clusterIPs={"IPv4":"10.104.197.248"} I0428 04:05:41.757905 1 handler.go:275] Adding GroupVersion controlplane.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:42.028493 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:42.096910 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:42.109702 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1alpha1 to ResourceManager I0428 04:05:42.176412 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:42.251534 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0428 04:05:42.273914 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1alpha1 to ResourceManager I0428 04:05:42.330358 1 alloc.go:330] "allocated clusterIPs" service="capo-system/capo-webhook-service" clusterIPs={"IPv4":"10.97.4.92"} I0428 04:06:41.446663 1 alloc.go:330] "allocated clusterIPs" service="openstack/magnum-api" clusterIPs={"IPv4":"10.100.140.42"} I0428 04:08:50.776928 1 alloc.go:330] "allocated clusterIPs" service="openstack/magnum-registry" clusterIPs={"IPv4":"10.110.182.100"} I0428 04:09:23.619561 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-manila" clusterIPs={"IPv4":"10.109.163.60"} I0428 04:09:27.205397 1 trace.go:236] Trace[250983140]: "Get" accept:application/json, */*,audit-id:0b29e556-e445-406a-8f9d-49d0ad65e3e7,client:10.0.0.172,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-manila-server-0,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 04:09:26.592) (total time: 613ms): Trace[250983140]: ---"About to write a response" 613ms (04:09:27.205) Trace[250983140]: [613.290944ms] [613.290944ms] END E0428 04:09:54.421371 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.19.213.142:57180->199.19.213.142:10250: write: broken pipe E0428 04:09:54.421443 1 upgradeaware.go:439] Error proxying data from backend to client: write tcp 199.19.213.142:6443->10.0.0.172:39726: write: broken pipe I0428 04:10:04.273555 1 trace.go:236] Trace[1394833850]: "Update" accept:application/json, */*,audit-id:6235e847-410c-41a4-9dc3-6427a62a327a,client:10.0.0.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:03.701) (total time: 571ms): Trace[1394833850]: ["GuaranteedUpdate etcd3" audit-id:6235e847-410c-41a4-9dc3-6427a62a327a,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 571ms (04:10:03.701) Trace[1394833850]: ---"Txn call completed" 571ms (04:10:04.273)] Trace[1394833850]: [571.972298ms] [571.972298ms] END I0428 04:10:04.273725 1 trace.go:236] Trace[1292295666]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cd1cf992-5ed2-487e-a19a-086124800549,client:10.0.0.136,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:03.692) (total time: 581ms): Trace[1292295666]: ["GuaranteedUpdate etcd3" audit-id:cd1cf992-5ed2-487e-a19a-086124800549,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 581ms (04:10:03.692) Trace[1292295666]: ---"Txn call completed" 580ms (04:10:04.273)] Trace[1292295666]: [581.528427ms] [581.528427ms] END I0428 04:10:04.273788 1 trace.go:236] Trace[991424486]: "Update" accept:application/json, */*,audit-id:79e3a801-544a-44b1-b05b-3ca647213b1d,client:10.0.0.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:03.705) (total time: 568ms): Trace[991424486]: ["GuaranteedUpdate etcd3" audit-id:79e3a801-544a-44b1-b05b-3ca647213b1d,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 568ms (04:10:03.705) Trace[991424486]: ---"Txn call completed" 567ms (04:10:04.273)] Trace[991424486]: [568.712131ms] [568.712131ms] END I0428 04:10:04.701588 1 trace.go:236] Trace[1128241433]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bd6f39d9-beef-4488-994f-9074446c322a,client:10.0.0.161,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:03.951) (total time: 750ms): Trace[1128241433]: ["GuaranteedUpdate etcd3" audit-id:bd6f39d9-beef-4488-994f-9074446c322a,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 750ms (04:10:03.951) Trace[1128241433]: ---"Txn call completed" 749ms (04:10:04.701)] Trace[1128241433]: [750.521759ms] [750.521759ms] END I0428 04:10:07.197211 1 trace.go:236] Trace[1410080662]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0608a098-9b21-49ba-9177-4f734efd9231,client:10.0.0.136,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:06.276) (total time: 920ms): Trace[1410080662]: ["GuaranteedUpdate etcd3" audit-id:0608a098-9b21-49ba-9177-4f734efd9231,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 920ms (04:10:06.276) Trace[1410080662]: ---"Txn call completed" 919ms (04:10:07.196)] Trace[1410080662]: [920.778661ms] [920.778661ms] END I0428 04:10:07.197383 1 trace.go:236] Trace[1208993529]: "Update" accept:application/json, */*,audit-id:7de3fabf-c11f-4a45-bb2f-cb15763a2f3d,client:10.0.0.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:06.277) (total time: 919ms): Trace[1208993529]: ["GuaranteedUpdate etcd3" audit-id:7de3fabf-c11f-4a45-bb2f-cb15763a2f3d,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 919ms (04:10:06.277) Trace[1208993529]: ---"Txn call completed" 918ms (04:10:07.197)] Trace[1208993529]: [919.654935ms] [919.654935ms] END I0428 04:10:07.811025 1 trace.go:236] Trace[2120737160]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1e812722-c897-488d-92a3-e3be616cb4ab,client:10.0.0.114,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:07.170) (total time: 639ms): Trace[2120737160]: ["GuaranteedUpdate etcd3" audit-id:1e812722-c897-488d-92a3-e3be616cb4ab,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 639ms (04:10:07.171) Trace[2120737160]: ---"Txn call completed" 639ms (04:10:07.810)] Trace[2120737160]: [639.978561ms] [639.978561ms] END I0428 04:10:07.811450 1 trace.go:236] Trace[360041223]: "Update" accept:application/json, */*,audit-id:34fd0af6-24a5-44d2-9b76-e3d8fa9ed52e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Apr-2026 04:10:07.246) (total time: 564ms): Trace[360041223]: ["GuaranteedUpdate etcd3" audit-id:34fd0af6-24a5-44d2-9b76-e3d8fa9ed52e,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 564ms (04:10:07.247) Trace[360041223]: ---"Txn call completed" 563ms (04:10:07.811)] Trace[360041223]: [564.530221ms] [564.530221ms] END I0428 04:10:07.811753 1 trace.go:236] Trace[245215506]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fa0052cc-d49a-491f-9890-66895bd3729d,client:199.19.213.142,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Apr-2026 04:10:07.287) (total time: 524ms): Trace[245215506]: ---"About to write a response" 524ms (04:10:07.811) Trace[245215506]: [524.207098ms] [524.207098ms] END I0428 04:10:08.520032 1 trace.go:236] Trace[2007540922]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.142,type:*v1.Endpoints,resource:apiServerIPInfo (28-Apr-2026 04:10:07.805) (total time: 714ms): Trace[2007540922]: ---"Transaction prepared" 289ms (04:10:08.114) Trace[2007540922]: ---"Txn call completed" 405ms (04:10:08.519) Trace[2007540922]: [714.445507ms] [714.445507ms] END I0428 04:10:08.832850 1 trace.go:236] Trace[859761224]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1df83949-74d8-4e82-8112-f122d6df2107,client:10.0.0.229,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 04:10:08.125) (total time: 707ms): Trace[859761224]: ["GuaranteedUpdate etcd3" audit-id:1df83949-74d8-4e82-8112-f122d6df2107,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 707ms (04:10:08.125) Trace[859761224]: ---"Txn call completed" 706ms (04:10:08.832)] Trace[859761224]: [707.272666ms] [707.272666ms] END I0428 04:10:08.835486 1 trace.go:236] Trace[1085209450]: "Get" accept:application/json, */*,audit-id:6b0df2d8-ae89-4ef6-9d72-5a9c365591f0,client:10.0.0.114,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (28-Apr-2026 04:10:08.118) (total time: 716ms): Trace[1085209450]: ---"About to write a response" 714ms (04:10:08.833) Trace[1085209450]: [716.612558ms] [716.612558ms] END I0428 04:10:41.596417 1 alloc.go:330] "allocated clusterIPs" service="openstack/manila-api" clusterIPs={"IPv4":"10.103.214.112"} I0428 04:13:03.285217 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.108.216.109"} I0428 04:13:03.299630 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.105.131.206"} I0428 04:19:47.840855 1 trace.go:236] Trace[127340696]: "List" accept:application/json,audit-id:33636074-0aae-45aa-901d-998063b9f490,client:199.19.213.142,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:cluster,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:LIST (28-Apr-2026 04:19:47.330) (total time: 510ms): Trace[127340696]: ---"Writing http response done" count:140 253ms (04:19:47.840) Trace[127340696]: [510.146583ms] [510.146583ms] END