I0324 15:01:05.041454 1 options.go:220] external host was not specified, using 199.19.213.121 I0324 15:01:05.042267 1 server.go:148] Version: v1.28.13 I0324 15:01:05.042340 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0324 15:01:05.462918 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0324 15:01:05.481602 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0324 15:01:05.481641 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0324 15:01:05.481960 1 instance.go:298] Using reconciler: lease I0324 15:01:05.522526 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0324 15:01:05.522553 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0324 15:01:05.766418 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0324 15:01:05.766601 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0324 15:01:06.246350 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0324 15:01:06.269116 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0324 15:01:06.269149 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.269157 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.269677 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0324 15:01:06.269692 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0324 15:01:06.270564 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0324 15:01:06.271301 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0324 15:01:06.271314 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0324 15:01:06.271319 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0324 15:01:06.272849 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0324 15:01:06.272864 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0324 15:01:06.273798 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0324 15:01:06.273813 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.273818 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.274376 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0324 15:01:06.274388 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.274429 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0324 15:01:06.275004 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0324 15:01:06.276739 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0324 15:01:06.276753 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.276757 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.277164 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0324 15:01:06.277176 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.277180 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.278061 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0324 15:01:06.278076 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0324 15:01:06.279982 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0324 15:01:06.279997 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.280003 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.280507 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0324 15:01:06.280522 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.280526 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.282670 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0324 15:01:06.282685 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.282689 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.284033 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0324 15:01:06.284901 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0324 15:01:06.284916 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.284920 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.287792 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0324 15:01:06.287808 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0324 15:01:06.287812 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0324 15:01:06.288530 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0324 15:01:06.288543 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0324 15:01:06.288547 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0324 15:01:06.289145 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0324 15:01:06.289158 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0324 15:01:06.321415 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0324 15:01:06.321447 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0324 15:01:06.743200 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0324 15:01:06.743260 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0324 15:01:06.743636 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0324 15:01:06.743660 1 secure_serving.go:213] Serving securely on [::]:6443 I0324 15:01:06.743735 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0324 15:01:06.743900 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0324 15:01:06.744255 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0324 15:01:06.744354 1 gc_controller.go:78] Starting apiserver lease garbage collector I0324 15:01:06.744378 1 available_controller.go:423] Starting AvailableConditionController I0324 15:01:06.744471 1 controller.go:134] Starting OpenAPI controller I0324 15:01:06.744512 1 controller.go:80] Starting OpenAPI V3 AggregationController I0324 15:01:06.744530 1 controller.go:85] Starting OpenAPI V3 controller I0324 15:01:06.744579 1 naming_controller.go:291] Starting NamingConditionController I0324 15:01:06.744611 1 establishing_controller.go:76] Starting EstablishingController I0324 15:01:06.744631 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0324 15:01:06.744641 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0324 15:01:06.744648 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0324 15:01:06.744664 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0324 15:01:06.744681 1 controller.go:78] Starting OpenAPI AggregationController I0324 15:01:06.744694 1 crd_finalizer.go:266] Starting CRDFinalizer I0324 15:01:06.744379 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0324 15:01:06.744475 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0324 15:01:06.744788 1 aggregator.go:164] waiting for initial CRD sync... I0324 15:01:06.744826 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0324 15:01:06.744844 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0324 15:01:06.744878 1 controller.go:116] Starting legacy_token_tracking_controller I0324 15:01:06.744898 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0324 15:01:06.744916 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0324 15:01:06.744943 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0324 15:01:06.744261 1 system_namespaces_controller.go:67] Starting system namespaces controller I0324 15:01:06.744971 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0324 15:01:06.745424 1 gc_controller.go:78] Starting apiserver lease garbage collector I0324 15:01:06.746337 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0324 15:01:06.746472 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0324 15:01:06.763029 1 shared_informer.go:318] Caches are synced for node_authorizer E0324 15:01:06.815568 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0324 15:01:06.844632 1 apf_controller.go:379] Running API Priority and Fairness config worker I0324 15:01:06.844666 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0324 15:01:06.844851 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0324 15:01:06.844895 1 cache.go:39] Caches are synced for AvailableConditionController controller I0324 15:01:06.845043 1 shared_informer.go:318] Caches are synced for configmaps I0324 15:01:06.845125 1 shared_informer.go:318] Caches are synced for crd-autoregister I0324 15:01:06.845116 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0324 15:01:06.845173 1 aggregator.go:166] initial CRD sync complete... I0324 15:01:06.845309 1 autoregister_controller.go:141] Starting autoregister controller I0324 15:01:06.845333 1 cache.go:32] Waiting for caches to sync for autoregister controller I0324 15:01:06.845350 1 cache.go:39] Caches are synced for autoregister controller I0324 15:01:06.847503 1 controller.go:624] quota admission added evaluator for: namespaces I0324 15:01:07.018593 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0324 15:01:07.752094 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0324 15:01:07.757267 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0324 15:01:07.757294 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0324 15:01:08.390053 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0324 15:01:08.445190 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0324 15:01:08.575659 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0324 15:01:08.585128 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.121] I0324 15:01:08.586585 1 controller.go:624] quota admission added evaluator for: endpoints I0324 15:01:08.592846 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0324 15:01:09.600954 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0324 15:01:10.200590 1 controller.go:624] quota admission added evaluator for: deployments.apps I0324 15:01:10.232383 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0324 15:01:10.410322 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0324 15:01:14.242666 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0324 15:01:14.890370 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0324 15:01:45.145400 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0324 15:01:45.161337 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0324 15:01:45.183189 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0324 15:01:45.189781 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.99.208.237"} I0324 15:01:45.204341 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.107.143.134"} I0324 15:01:45.231692 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0324 15:01:45.291627 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0324 15:01:45.322275 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0324 15:01:45.548340 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0324 15:01:45.677743 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0324 15:01:45.746949 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0324 15:01:45.806266 1 controller.go:624] quota admission added evaluator for: jobs.batch I0324 15:01:45.946719 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0324 15:01:46.144512 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0324 15:01:46.354882 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0324 15:01:46.574451 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0324 15:01:46.753775 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0324 15:01:48.766366 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0324 15:01:49.339761 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0324 15:01:49.756813 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0324 15:01:53.738034 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io W0324 15:02:01.792581 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.99.208.237:443: connect: connection refused I0324 15:02:06.791349 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0324 15:02:12.347009 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0324 15:02:25.797196 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.108.99.27"} I0324 15:02:25.805126 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.101.127.207"} I0324 15:02:25.813190 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.97.209.195"} I0324 15:02:25.824722 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.100.57.156"} I0324 15:02:32.247214 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.266287 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.301908 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.334604 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.352415 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.372189 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.399291 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.419798 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.440933 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.462986 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0324 15:02:32.486740 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.506577 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:32.523701 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:33.809795 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0324 15:02:36.654927 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0324 15:02:36.662002 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0324 15:02:36.722903 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.102.242.169"} I0324 15:02:36.760531 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0324 15:02:38.944403 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0324 15:02:38.975520 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0324 15:02:39.594103 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0324 15:02:39.594166 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0324 15:02:39.594211 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0324 15:02:45.455648 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0324 15:02:49.527122 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.101.131.189"} I0324 15:02:49.800032 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0324 15:02:49.952608 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.110.17.27"} I0324 15:02:49.966579 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.98.7.222"} I0324 15:04:18.900557 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.98.232.95"} I0324 15:04:21.338629 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.100.189.240"} I0324 15:04:21.346210 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.111.165.87"} I0324 15:04:27.589477 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.96.101.157"} I0324 15:04:27.600012 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.111.141.34"} I0324 15:06:51.348820 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0324 15:06:55.001560 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0324 15:06:55.033776 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0324 15:06:58.528165 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0324 15:06:58.546922 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0324 15:06:58.559598 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0324 15:06:58.569865 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0324 15:06:58.589080 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0324 15:06:58.602017 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0324 15:06:58.612594 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0324 15:07:00.317296 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0324 15:07:11.219472 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0324 15:07:50.552772 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0324 15:08:04.852761 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0324 15:08:05.036891 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:05.063800 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:05.069172 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:05.352854 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0324 15:08:05.569935 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:05.573559 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:05.697313 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0324 15:08:05.702452 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:05.807711 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0324 15:08:42.613644 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.103.8.68"} I0324 15:08:42.624242 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.101.37.179"} I0324 15:08:42.630116 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.110.67.216"} I0324 15:08:42.638552 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.96.153.188"} I0324 15:08:42.645339 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.101.134.194"} I0324 15:08:42.652494 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.111.219.228"} I0324 15:08:42.689183 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0324 15:08:42.697471 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0324 15:08:42.756308 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0324 15:08:42.773902 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0324 15:08:42.791126 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0324 15:08:42.798843 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.798884 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.799324 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.799347 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.799356 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.799374 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.799896 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.799918 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.799922 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.799943 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.800261 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.800287 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.800558 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.800590 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.800800 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.800829 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.800981 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801000 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.801046 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801059 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.801146 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801176 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.801582 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801606 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.801683 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801704 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.801710 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801724 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.801853 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.801889 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused W0324 15:08:42.802306 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused E0324 15:08:42.802326 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.111.219.228:443: connect: connection refused I0324 15:08:53.150770 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.102.23.201"} I0324 15:08:53.161610 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.106.132.238"} I0324 15:08:57.738023 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.110.139.185"} I0324 15:09:00.394980 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.103.63.151"} I0324 15:09:04.975231 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.99.97.254"} I0324 15:09:05.858957 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.105.163.13"} I0324 15:09:12.762213 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0324 15:09:12.920937 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.105.20.33"} I0324 15:09:53.544317 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.96.36.125"} I0324 15:09:53.558172 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0324 15:12:54.865945 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.111.205.186"} I0324 15:13:28.163390 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.105.250.129"} E0324 15:13:53.018264 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc009064ea0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc00cc4ef50), ResponseWriter:(*httpsnoop.rw)(0xc00cc4ef50), Flusher:(*httpsnoop.rw)(0xc00cc4ef50), CloseNotifier:(*httpsnoop.rw)(0xc00cc4ef50), Pusher:(*httpsnoop.rw)(0xc00cc4ef50)}}, encoder:(*versioning.codec)(0xc02a824b40), memAllocator:(*runtime.Allocator)(0xc0081dab10)}) I0324 15:15:19.441116 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0324 15:15:19.458165 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.469132 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.478124 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.494512 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.506353 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0324 15:15:19.515684 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.533284 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.547851 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.553926 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.572895 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.584448 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.602439 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.649618 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.662185 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.696247 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.742020 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:19.868435 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0324 15:15:59.582846 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0324 15:15:59.591909 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0324 15:16:33.034026 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.99.116.46"} I0324 15:16:33.977070 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.111.188.234"} I0324 15:16:36.975058 1 trace.go:236] Trace[2017877290]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c86407eb-5e27-4b15-a671-7f3355d2da90,client:10.0.0.193,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Mar-2026 15:16:36.469) (total time: 505ms): Trace[2017877290]: ["GuaranteedUpdate etcd3" audit-id:c86407eb-5e27-4b15-a671-7f3355d2da90,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 505ms (15:16:36.469) Trace[2017877290]: ---"Txn call completed" 504ms (15:16:36.974)] Trace[2017877290]: [505.618825ms] [505.618825ms] END I0324 15:16:37.991421 1 trace.go:236] Trace[1120101385]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a21d889a-60ab-4049-80c8-73891ad6aadb,client:10.0.0.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Mar-2026 15:16:36.560) (total time: 1431ms): Trace[1120101385]: ["GuaranteedUpdate etcd3" audit-id:a21d889a-60ab-4049-80c8-73891ad6aadb,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1430ms (15:16:36.560) Trace[1120101385]: ---"Txn call completed" 1429ms (15:16:37.991)] Trace[1120101385]: [1.431129455s] [1.431129455s] END I0324 15:16:37.991557 1 trace.go:236] Trace[295793649]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f2934e9c-c964-4faa-98ee-44d5a58644c9,client:10.0.0.170,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Mar-2026 15:16:36.562) (total time: 1429ms): Trace[295793649]: ["GuaranteedUpdate etcd3" audit-id:f2934e9c-c964-4faa-98ee-44d5a58644c9,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1429ms (15:16:36.562) Trace[295793649]: ---"Txn call completed" 1428ms (15:16:37.991)] Trace[295793649]: [1.429099016s] [1.429099016s] END I0324 15:16:37.991886 1 trace.go:236] Trace[124476080]: "Get" accept:application/json, */*,audit-id:2f46531d-14fc-41b7-a7a5-edb822a3bdd1,client:10.0.0.227,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-78c99faf-1521-473e-9717-a6b51ccfb8c5,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:16:37.134) (total time: 857ms): Trace[124476080]: ---"About to write a response" 857ms (15:16:37.991) Trace[124476080]: [857.634565ms] [857.634565ms] END I0324 15:16:37.991894 1 trace.go:236] Trace[1768874953]: "Get" accept:application/json, */*,audit-id:06b4aefd-94e8-446b-ab04-2018d4ae6d77,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:16:37.068) (total time: 923ms): Trace[1768874953]: ---"About to write a response" 923ms (15:16:37.991) Trace[1768874953]: [923.164115ms] [923.164115ms] END I0324 15:16:37.991932 1 trace.go:236] Trace[275260046]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f39cacdc-bc9f-48c9-8fd4-288f73ca5b93,client:10.0.0.121,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:16:37.068) (total time: 923ms): Trace[275260046]: ---"About to write a response" 923ms (15:16:37.991) Trace[275260046]: [923.749346ms] [923.749346ms] END I0324 15:16:37.992210 1 trace.go:236] Trace[1104552537]: "Get" accept:application/json, */*,audit-id:bdefa651-1278-43f7-a349-08657d97463f,client:199.19.213.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Mar-2026 15:16:36.957) (total time: 1034ms): Trace[1104552537]: ---"About to write a response" 1033ms (15:16:37.991) Trace[1104552537]: [1.034824682s] [1.034824682s] END I0324 15:17:07.857858 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.107.247.236"} E0324 15:17:15.126517 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0324 15:17:15.126564 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0324 15:17:15.126580 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 26.401µs, panicked: false, err: context deadline exceeded, panic-reason: E0324 15:17:15.127699 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0324 15:17:15.127785 1 trace.go:236] Trace[1390983377]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e1acd0fd-6ac9-4560-b4e1-1b799ea73d8a,client:10.0.0.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Mar-2026 15:17:10.126) (total time: 5000ms): Trace[1390983377]: ["GuaranteedUpdate etcd3" audit-id:e1acd0fd-6ac9-4560-b4e1-1b799ea73d8a,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (15:17:10.127) Trace[1390983377]: ---"Txn call failed" err:context deadline exceeded 4998ms (15:17:15.126)] Trace[1390983377]: [5.000812493s] [5.000812493s] END E0324 15:17:15.128124 1 timeout.go:142] post-timeout activity - time-elapsed: 1.57762ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0324 15:17:15.132412 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0324 15:17:15.132446 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 12.83µs, panicked: false, err: context canceled, panic-reason: E0324 15:17:15.132468 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0324 15:17:15.133797 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0324 15:17:15.133900 1 trace.go:236] Trace[1657123566]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a2237b3f-697e-4892-b388-5c8abb18ec23,client:10.0.0.170,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Mar-2026 15:17:10.132) (total time: 5001ms): Trace[1657123566]: ["GuaranteedUpdate etcd3" audit-id:a2237b3f-697e-4892-b388-5c8abb18ec23,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (15:17:10.132) Trace[1657123566]: ---"Txn call failed" err:context canceled 4999ms (15:17:15.132)] Trace[1657123566]: [5.001758971s] [5.001758971s] END E0324 15:17:15.134108 1 timeout.go:142] post-timeout activity - time-elapsed: 1.804785ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0324 15:17:15.199699 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0324 15:17:15.199805 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0324 15:17:15.200832 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0324 15:17:15.200904 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0324 15:17:15.202192 1 trace.go:236] Trace[973394097]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a479c5dd-ad0c-4938-b333-95e268091115,client:199.19.213.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Mar-2026 15:17:10.199) (total time: 5001ms): Trace[973394097]: [5.001984724s] [5.001984724s] END E0324 15:17:15.202487 1 timeout.go:142] post-timeout activity - time-elapsed: 2.580999ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0324 15:17:15.355141 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0324 15:17:15.355264 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0324 15:17:15.357300 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0324 15:17:15.357384 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0324 15:17:15.358634 1 trace.go:236] Trace[1640958258]: "Get" accept:application/json, */*,audit-id:30e605ab-cd44-4280-a78a-9210a2101bd4,client:199.19.213.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Mar-2026 15:17:10.355) (total time: 5002ms): Trace[1640958258]: [5.002966983s] [5.002966983s] END E0324 15:17:15.358812 1 timeout.go:142] post-timeout activity - time-elapsed: 3.517535ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0324 15:17:15.422194 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0324 15:17:15.422280 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0324 15:17:15.423466 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0324 15:17:15.423572 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0324 15:17:15.424633 1 trace.go:236] Trace[155859078]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:13a215fc-ecfd-4876-aa61-63463e90d196,client:199.19.213.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (24-Mar-2026 15:17:10.422) (total time: 5002ms): Trace[155859078]: [5.002029356s] [5.002029356s] END E0324 15:17:15.424822 1 timeout.go:142] post-timeout activity - time-elapsed: 2.410875ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0324 15:17:16.117605 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0324 15:17:16.117665 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0324 15:17:16.117772 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 18.21µs, panicked: false, err: context canceled, panic-reason: E0324 15:17:16.119017 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0324 15:17:16.119123 1 trace.go:236] Trace[469554971]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:225cf77f-227e-48e5-819e-7ecbeff41b57,client:10.0.0.193,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (24-Mar-2026 15:17:11.118) (total time: 5000ms): Trace[469554971]: ["GuaranteedUpdate etcd3" audit-id:225cf77f-227e-48e5-819e-7ecbeff41b57,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (15:17:11.118) Trace[469554971]: ---"Txn call failed" err:context canceled 4997ms (15:17:16.117)] Trace[469554971]: [5.000939495s] [5.000939495s] END E0324 15:17:16.119298 1 timeout.go:142] post-timeout activity - time-elapsed: 1.707482ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0324 15:17:16.655185 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0324 15:17:16.655366 1 trace.go:236] Trace[870149042]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:02aafa09-4fd7-4935-9818-77df2084bce4,client:199.19.213.121,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/glance-api-64ffb84674-bwc2w.189fcff4b55c14df,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Mar-2026 15:17:09.648) (total time: 7006ms): Trace[870149042]: ["GuaranteedUpdate etcd3" audit-id:02aafa09-4fd7-4935-9818-77df2084bce4,key:/events/openstack/glance-api-64ffb84674-bwc2w.189fcff4b55c14df,type:*core.Event,resource:events 7006ms (15:17:09.648) Trace[870149042]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (15:17:16.655)] Trace[870149042]: [7.006671143s] [7.006671143s] END I0324 15:17:17.464118 1 trace.go:236] Trace[545147005]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7518192d-8fb9-44fc-95ae-41c1dcce4990,client:199.19.213.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (24-Mar-2026 15:17:10.485) (total time: 6978ms): Trace[545147005]: ["GuaranteedUpdate etcd3" audit-id:7518192d-8fb9-44fc-95ae-41c1dcce4990,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 6978ms (15:17:10.485) Trace[545147005]: ---"Txn call completed" 6977ms (15:17:17.463)] Trace[545147005]: [6.978458186s] [6.978458186s] END I0324 15:17:17.465310 1 trace.go:236] Trace[52614032]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:06c28d05-6660-454c-97cd-6ab03b9d60d7,client:199.19.213.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Mar-2026 15:17:10.731) (total time: 6733ms): Trace[52614032]: ["GuaranteedUpdate etcd3" audit-id:06c28d05-6660-454c-97cd-6ab03b9d60d7,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6733ms (15:17:10.731) Trace[52614032]: ---"Txn call completed" 6732ms (15:17:17.464)] Trace[52614032]: [6.733425277s] [6.733425277s] END I0324 15:17:17.492675 1 trace.go:236] Trace[637577717]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8f7ecdce-10c7-42b3-882a-75de9f897c18,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (24-Mar-2026 15:17:16.463) (total time: 1029ms): Trace[637577717]: ["GuaranteedUpdate etcd3" audit-id:8f7ecdce-10c7-42b3-882a-75de9f897c18,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1029ms (15:17:16.463) Trace[637577717]: ---"Txn call completed" 1027ms (15:17:17.492)] Trace[637577717]: [1.029250854s] [1.029250854s] END I0324 15:17:17.493296 1 trace.go:236] Trace[389359900]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6d6e9827-c7c0-4598-abbb-38de74337a23,client:10.0.0.170,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Mar-2026 15:17:15.133) (total time: 2359ms): Trace[389359900]: ---"About to write a response" 2359ms (15:17:17.493) Trace[389359900]: [2.359705156s] [2.359705156s] END I0324 15:17:17.493412 1 trace.go:236] Trace[293288574]: "Get" accept:application/json, */*,audit-id:1fe6909f-e59f-4f22-9a84-d47bb18a8248,client:10.0.0.125,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (24-Mar-2026 15:17:14.881) (total time: 2611ms): Trace[293288574]: ---"About to write a response" 2611ms (15:17:17.493) Trace[293288574]: [2.61196879s] [2.61196879s] END I0324 15:17:17.493701 1 trace.go:236] Trace[2126911978]: "Get" accept:application/json, */*,audit-id:90c51a64-ef03-4298-8127-cfc601de228a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:17:10.365) (total time: 7128ms): Trace[2126911978]: ---"About to write a response" 7128ms (15:17:17.493) Trace[2126911978]: [7.128337511s] [7.128337511s] END I0324 15:17:17.494594 1 trace.go:236] Trace[424444696]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2aa881cb-312e-4f4b-8e2c-9fab8f0b7280,client:10.0.0.121,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Mar-2026 15:17:15.128) (total time: 2366ms): Trace[424444696]: ---"About to write a response" 2366ms (15:17:17.494) Trace[424444696]: [2.366393071s] [2.366393071s] END I0324 15:17:17.495400 1 trace.go:236] Trace[1374122590]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7f230d54-e5c0-4a69-99f0-79d2bc3a1773,client:10.0.0.121,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:17:13.699) (total time: 3795ms): Trace[1374122590]: ---"About to write a response" 3795ms (15:17:17.494) Trace[1374122590]: [3.795435291s] [3.795435291s] END I0324 15:17:17.495569 1 trace.go:236] Trace[682532904]: "Get" accept:application/json, */*,audit-id:4e787b4d-4fdf-4b45-8b36-426a1ab7822d,client:199.19.213.121,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-xcg2v,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:17:10.373) (total time: 7121ms): Trace[682532904]: ---"About to write a response" 7121ms (15:17:17.495) Trace[682532904]: [7.121765988s] [7.121765988s] END I0324 15:17:17.497178 1 trace.go:236] Trace[458794877]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:603f14ff-6b36-4433-9b09-7dd872b8b366,client:10.0.0.193,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (24-Mar-2026 15:17:16.118) (total time: 1378ms): Trace[458794877]: ---"About to write a response" 1378ms (15:17:17.496) Trace[458794877]: [1.378403622s] [1.378403622s] END I0324 15:17:17.497357 1 trace.go:236] Trace[508673776]: "Get" accept:application/json, */*,audit-id:ddeebe16-ff28-435d-b14f-caa0bffc4c93,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (24-Mar-2026 15:17:10.365) (total time: 7131ms): Trace[508673776]: ---"About to write a response" 7131ms (15:17:17.497) Trace[508673776]: [7.131569891s] [7.131569891s] END I0324 15:17:17.497470 1 trace.go:236] Trace[719443410]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:172dfd17-8d7c-4ce9-8fdc-eb1d64024463,client:199.19.213.121,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (24-Mar-2026 15:17:16.342) (total time: 1154ms): Trace[719443410]: ---"About to write a response" 1154ms (15:17:17.497) Trace[719443410]: [1.154482198s] [1.154482198s] END I0324 15:17:17.594169 1 trace.go:236] Trace[587802285]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0a3bb8a4-78d6-409c-9d5b-bb01a9348d53,client:199.19.213.121,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/glance-api-64ffb84674-bwc2w.189fcff4b55c14df,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (24-Mar-2026 15:17:16.657) (total time: 936ms): Trace[587802285]: ["GuaranteedUpdate etcd3" audit-id:0a3bb8a4-78d6-409c-9d5b-bb01a9348d53,key:/events/openstack/glance-api-64ffb84674-bwc2w.189fcff4b55c14df,type:*core.Event,resource:events 936ms (15:17:16.657) Trace[587802285]: ---"initial value restored" 838ms (15:17:17.495) Trace[587802285]: ---"Txn call completed" 96ms (15:17:17.593)] Trace[587802285]: ---"Object stored in database" 97ms (15:17:17.593) Trace[587802285]: [936.733311ms] [936.733311ms] END I0324 15:21:40.418353 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.100.9.19"}