I0421 18:17:58.477101 1 options.go:220] external host was not specified, using 199.19.213.191 I0421 18:17:58.478127 1 server.go:148] Version: v1.28.13 I0421 18:17:58.478178 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0421 18:17:58.848182 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0421 18:17:58.855322 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0421 18:17:58.855341 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0421 18:17:58.855506 1 instance.go:298] Using reconciler: lease I0421 18:17:59.519013 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0421 18:17:59.519039 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0421 18:17:59.788341 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0421 18:17:59.788628 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0421 18:18:00.273896 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0421 18:18:00.308091 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0421 18:18:00.308613 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.308625 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.309350 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0421 18:18:00.309370 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0421 18:18:00.310432 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0421 18:18:00.311193 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0421 18:18:00.311214 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0421 18:18:00.311220 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0421 18:18:00.312754 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0421 18:18:00.312774 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0421 18:18:00.313814 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0421 18:18:00.313834 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.313840 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.314487 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0421 18:18:00.314507 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.314551 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0421 18:18:00.315219 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0421 18:18:00.317454 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0421 18:18:00.317476 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.317482 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.318054 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0421 18:18:00.318076 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.318082 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.319030 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0421 18:18:00.319048 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0421 18:18:00.320953 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0421 18:18:00.320974 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.320980 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.321504 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0421 18:18:00.321529 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.321535 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.323869 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0421 18:18:00.323889 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.323894 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.325296 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0421 18:18:00.326178 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0421 18:18:00.326194 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.326200 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.328900 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0421 18:18:00.328921 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0421 18:18:00.328925 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0421 18:18:00.330145 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0421 18:18:00.330162 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0421 18:18:00.330165 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0421 18:18:00.330634 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0421 18:18:00.330648 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0421 18:18:00.369855 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0421 18:18:00.369891 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0421 18:18:00.745109 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0421 18:18:00.745178 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0421 18:18:00.745506 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0421 18:18:00.745704 1 secure_serving.go:213] Serving securely on [::]:6443 I0421 18:18:00.745800 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0421 18:18:00.745872 1 aggregator.go:164] waiting for initial CRD sync... I0421 18:18:00.745895 1 controller.go:80] Starting OpenAPI V3 AggregationController I0421 18:18:00.745982 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0421 18:18:00.746182 1 gc_controller.go:78] Starting apiserver lease garbage collector I0421 18:18:00.745804 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0421 18:18:00.746257 1 gc_controller.go:78] Starting apiserver lease garbage collector I0421 18:18:00.746358 1 available_controller.go:423] Starting AvailableConditionController I0421 18:18:00.746379 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0421 18:18:00.746401 1 controller.go:78] Starting OpenAPI AggregationController I0421 18:18:00.746425 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0421 18:18:00.746447 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0421 18:18:00.746461 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0421 18:18:00.746477 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0421 18:18:00.746587 1 controller.go:116] Starting legacy_token_tracking_controller I0421 18:18:00.746618 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0421 18:18:00.746646 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0421 18:18:00.746672 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0421 18:18:00.746704 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0421 18:18:00.746731 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0421 18:18:00.746761 1 controller.go:85] Starting OpenAPI V3 controller I0421 18:18:00.746804 1 system_namespaces_controller.go:67] Starting system namespaces controller I0421 18:18:00.746829 1 naming_controller.go:291] Starting NamingConditionController I0421 18:18:00.746863 1 establishing_controller.go:76] Starting EstablishingController I0421 18:18:00.746893 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0421 18:18:00.746597 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0421 18:18:00.746935 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0421 18:18:00.746970 1 crd_finalizer.go:266] Starting CRDFinalizer I0421 18:18:00.747038 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0421 18:18:00.747715 1 controller.go:134] Starting OpenAPI controller E0421 18:18:00.818657 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0421 18:18:00.846087 1 apf_controller.go:379] Running API Priority and Fairness config worker I0421 18:18:00.846114 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0421 18:18:00.846463 1 cache.go:39] Caches are synced for AvailableConditionController controller I0421 18:18:00.846583 1 shared_informer.go:318] Caches are synced for crd-autoregister I0421 18:18:00.846595 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0421 18:18:00.846619 1 aggregator.go:166] initial CRD sync complete... I0421 18:18:00.846628 1 autoregister_controller.go:141] Starting autoregister controller I0421 18:18:00.846635 1 cache.go:32] Waiting for caches to sync for autoregister controller I0421 18:18:00.846641 1 cache.go:39] Caches are synced for autoregister controller I0421 18:18:00.846912 1 shared_informer.go:318] Caches are synced for configmaps I0421 18:18:00.846991 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0421 18:18:00.848282 1 shared_informer.go:318] Caches are synced for node_authorizer I0421 18:18:00.848635 1 controller.go:624] quota admission added evaluator for: namespaces I0421 18:18:01.024011 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0421 18:18:01.756532 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0421 18:18:01.761764 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0421 18:18:01.761860 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0421 18:18:02.345140 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0421 18:18:02.395659 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0421 18:18:02.459965 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0421 18:18:02.466833 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.191] I0421 18:18:02.467672 1 controller.go:624] quota admission added evaluator for: endpoints I0421 18:18:02.473309 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0421 18:18:04.268702 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0421 18:18:04.276111 1 controller.go:624] quota admission added evaluator for: deployments.apps I0421 18:18:04.293003 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0421 18:18:04.495881 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0421 18:18:10.023759 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0421 18:18:10.171724 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0421 18:18:44.146846 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0421 18:18:44.163481 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0421 18:18:44.163532 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0421 18:18:44.191822 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0421 18:18:44.222008 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0421 18:18:44.240616 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0421 18:18:44.254721 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0421 18:18:44.275388 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0421 18:18:44.275470 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0421 18:18:44.304437 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0421 18:18:44.341105 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0421 18:18:44.341207 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0421 18:18:44.387125 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0421 18:18:44.387274 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0421 18:18:44.424479 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0421 18:18:44.552981 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:44.653136 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:44.792418 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0421 18:18:44.792499 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0421 18:18:44.813493 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:44.866402 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:44.880805 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:45.511374 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:45.578402 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0421 18:18:51.257559 1 controller.go:624] quota admission added evaluator for: jobs.batch I0421 18:18:53.792171 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0421 18:18:53.804838 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0421 18:18:54.071097 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0421 18:18:54.256589 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0421 18:18:54.462354 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0421 18:18:54.671641 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0421 18:18:54.862105 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0421 18:18:55.088236 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0421 18:18:55.721293 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0421 18:18:57.278618 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0421 18:18:57.361917 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0421 18:18:57.362008 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0421 18:18:57.676020 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0421 18:19:00.364164 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0421 18:19:09.707023 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.103.32.224"} W0421 18:19:09.741211 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.32.224:9443: connect: connection refused E0421 18:19:09.741262 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.32.224:9443: connect: connection refused I0421 18:19:22.669755 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0421 18:19:22.678028 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0421 18:19:22.707026 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0421 18:19:22.745447 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.99.159.226"} I0421 18:19:22.753171 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.104.20.125"} I0421 18:19:22.770742 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0421 18:19:22.829378 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0421 18:19:22.865482 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0421 18:19:33.552396 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0421 18:19:39.634579 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0421 18:19:53.987189 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.98.141.67"} I0421 18:19:53.995103 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.105.102.203"} I0421 18:19:54.006728 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.105.118.22"} I0421 18:19:54.015974 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.102.1.223"} I0421 18:20:00.521955 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.546990 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.570277 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.592606 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.610042 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.631337 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.648652 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.666599 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.690296 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.708469 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0421 18:20:00.728583 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.747057 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:00.771129 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:02.049131 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0421 18:20:05.830103 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0421 18:20:05.841596 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0421 18:20:05.901703 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.110.20.244"} I0421 18:20:05.930138 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0421 18:20:08.229528 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0421 18:20:08.276176 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0421 18:20:08.924283 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0421 18:20:08.924378 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0421 18:20:08.924445 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0421 18:20:15.614411 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0421 18:20:19.525586 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.106.197.172"} I0421 18:20:19.795833 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0421 18:20:20.050357 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.109.83.20"} I0421 18:20:20.070631 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.109.194.101"} I0421 18:21:51.355596 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.96.143.40"} I0421 18:21:53.856277 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.109.23.119"} I0421 18:21:53.864218 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.101.64.42"} I0421 18:22:00.399548 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.103.188.16"} I0421 18:22:00.407259 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.105.20.201"} I0421 18:23:52.722148 1 trace.go:236] Trace[618876365]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d020a6c9-4549-4bff-b313-08a8b7ecc704,client:10.0.0.243,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Apr-2026 18:23:52.186) (total time: 535ms): Trace[618876365]: ["GuaranteedUpdate etcd3" audit-id:d020a6c9-4549-4bff-b313-08a8b7ecc704,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 535ms (18:23:52.186) Trace[618876365]: ---"Txn call completed" 534ms (18:23:52.721)] Trace[618876365]: [535.45335ms] [535.45335ms] END E0421 18:23:58.279341 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0421 18:23:58.279365 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0421 18:23:58.279382 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 4.451µs, panicked: false, err: context deadline exceeded, panic-reason: E0421 18:23:58.280751 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0421 18:23:58.280787 1 trace.go:236] Trace[2053098948]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1fe8aad3-daaa-45dc-ba4c-583d09edf3e0,client:199.19.213.191,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (21-Apr-2026 18:23:53.279) (total time: 5001ms): Trace[2053098948]: ["GuaranteedUpdate etcd3" audit-id:1fe8aad3-daaa-45dc-ba4c-583d09edf3e0,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (18:23:53.279) Trace[2053098948]: ---"Txn call failed" err:context deadline exceeded 4998ms (18:23:58.279)] Trace[2053098948]: [5.001352878s] [5.001352878s] END E0421 18:23:58.281867 1 timeout.go:142] post-timeout activity - time-elapsed: 1.46384ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0421 18:23:58.510428 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0421 18:23:58.510533 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0421 18:23:58.511770 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0421 18:23:58.511840 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0421 18:23:58.513916 1 trace.go:236] Trace[898516980]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d201bf3b-d90c-4290-8db1-69c04e5c55e2,client:199.19.213.191,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (21-Apr-2026 18:23:53.511) (total time: 5002ms): Trace[898516980]: [5.0028737s] [5.0028737s] END E0421 18:23:58.514034 1 timeout.go:142] post-timeout activity - time-elapsed: 3.546057ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0421 18:23:58.582627 1 trace.go:236] Trace[1579352135]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aacdbd94-0f68-4895-aabe-753129834273,client:199.19.213.191,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (21-Apr-2026 18:23:53.323) (total time: 5259ms): Trace[1579352135]: ["GuaranteedUpdate etcd3" audit-id:aacdbd94-0f68-4895-aabe-753129834273,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 5259ms (18:23:53.323) Trace[1579352135]: ---"Txn call completed" 5258ms (18:23:58.582)] Trace[1579352135]: [5.259461413s] [5.259461413s] END I0421 18:23:58.582633 1 trace.go:236] Trace[494095784]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cbce0db8-9e2f-42f3-b2ce-981190787e44,client:10.0.0.17,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Apr-2026 18:23:55.869) (total time: 2713ms): Trace[494095784]: ["GuaranteedUpdate etcd3" audit-id:cbce0db8-9e2f-42f3-b2ce-981190787e44,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2713ms (18:23:55.869) Trace[494095784]: ---"Txn call completed" 2712ms (18:23:58.582)] Trace[494095784]: [2.713093278s] [2.713093278s] END I0421 18:23:58.582739 1 trace.go:236] Trace[1260728274]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d21ed382-4c82-43d2-8989-b3dd7feb41de,client:10.0.0.73,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Apr-2026 18:23:53.924) (total time: 4657ms): Trace[1260728274]: ["GuaranteedUpdate etcd3" audit-id:d21ed382-4c82-43d2-8989-b3dd7feb41de,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4657ms (18:23:53.925) Trace[1260728274]: ---"Txn call completed" 4656ms (18:23:58.582)] Trace[1260728274]: [4.657765557s] [4.657765557s] END I0421 18:23:58.582856 1 trace.go:236] Trace[2056617276]: "Update" accept:application/json, */*,audit-id:7ba52adc-a932-4e0e-8213-e267da9ced34,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (21-Apr-2026 18:23:53.279) (total time: 5303ms): Trace[2056617276]: ["GuaranteedUpdate etcd3" audit-id:7ba52adc-a932-4e0e-8213-e267da9ced34,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5302ms (18:23:53.279) Trace[2056617276]: ---"Txn call completed" 5301ms (18:23:58.582)] Trace[2056617276]: [5.303151633s] [5.303151633s] END I0421 18:23:58.582892 1 trace.go:236] Trace[2012636724]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:31e9f261-a934-4aa7-82fd-a9d9da578839,client:10.0.0.243,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Apr-2026 18:23:54.724) (total time: 3858ms): Trace[2012636724]: ["GuaranteedUpdate etcd3" audit-id:31e9f261-a934-4aa7-82fd-a9d9da578839,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 3857ms (18:23:54.724) Trace[2012636724]: ---"Txn call completed" 3856ms (18:23:58.582)] Trace[2012636724]: [3.858050906s] [3.858050906s] END I0421 18:23:58.583001 1 trace.go:236] Trace[892958752]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1121f9be-4a69-49fc-8103-e71d389ffa56,client:10.0.0.212,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Apr-2026 18:23:54.726) (total time: 3856ms): Trace[892958752]: ["GuaranteedUpdate etcd3" audit-id:1121f9be-4a69-49fc-8103-e71d389ffa56,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3856ms (18:23:54.726) Trace[892958752]: ---"Txn call completed" 3855ms (18:23:58.582)] Trace[892958752]: [3.856598166s] [3.856598166s] END I0421 18:23:58.589425 1 trace.go:236] Trace[1476870760]: "Get" accept:application/json, */*,audit-id:52b36d19-3d92-469b-8b31-06940803368c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (21-Apr-2026 18:23:54.729) (total time: 3860ms): Trace[1476870760]: ---"About to write a response" 3859ms (18:23:58.589) Trace[1476870760]: [3.860105872s] [3.860105872s] END I0421 18:23:58.589443 1 trace.go:236] Trace[2068772452]: "Get" accept:application/json, */*,audit-id:9b10e86a-fc0b-4f18-816e-1001338ec4e9,client:199.19.213.191,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (21-Apr-2026 18:23:54.455) (total time: 4134ms): Trace[2068772452]: ---"About to write a response" 4134ms (18:23:58.589) Trace[2068772452]: [4.134373616s] [4.134373616s] END I0421 18:23:58.589456 1 trace.go:236] Trace[23227083]: "Get" accept:application/json, */*,audit-id:96ed8cf9-77ae-44ad-9052-3105d4cf114b,client:199.19.213.191,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Apr-2026 18:23:53.597) (total time: 4991ms): Trace[23227083]: ---"About to write a response" 4991ms (18:23:58.589) Trace[23227083]: [4.991476931s] [4.991476931s] END I0421 18:23:58.589462 1 trace.go:236] Trace[1284115310]: "Get" accept:application/json, */*,audit-id:50d78847-4779-43d1-9a47-aa00280d6b1b,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (21-Apr-2026 18:23:55.876) (total time: 2712ms): Trace[1284115310]: ---"About to write a response" 2712ms (18:23:58.589) Trace[1284115310]: [2.712522092s] [2.712522092s] END I0421 18:23:58.589426 1 trace.go:236] Trace[672304213]: "Get" accept:application/json, */*,audit-id:f6447627-53ce-4ad8-a4d3-a3711ca6c7bf,client:10.0.0.46,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (21-Apr-2026 18:23:57.659) (total time: 929ms): Trace[672304213]: ---"About to write a response" 929ms (18:23:58.589) Trace[672304213]: [929.864938ms] [929.864938ms] END I0421 18:23:58.591964 1 trace.go:236] Trace[1005261533]: "Get" accept:application/json, */*,audit-id:7225ef02-ea4e-441e-93e3-0abcf289e8aa,client:10.0.0.243,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (21-Apr-2026 18:23:53.281) (total time: 5310ms): Trace[1005261533]: ---"About to write a response" 5307ms (18:23:58.588) Trace[1005261533]: [5.310477822s] [5.310477822s] END I0421 18:23:58.592788 1 trace.go:236] Trace[887039722]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:91adb748-eea2-4886-bd10-ce3be95587e4,client:199.19.213.191,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18a8724ecbba18b0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (21-Apr-2026 18:23:55.876) (total time: 2715ms): Trace[887039722]: ["GuaranteedUpdate etcd3" audit-id:91adb748-eea2-4886-bd10-ce3be95587e4,key:/events/auth-system/keycloak-0.18a8724ecbba18b0,type:*core.Event,resource:events 2715ms (18:23:55.877) Trace[887039722]: ---"initial value restored" 2711ms (18:23:58.588)] Trace[887039722]: [2.7157339s] [2.7157339s] END I0421 18:24:34.263020 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0421 18:24:38.314659 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0421 18:24:38.349136 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0421 18:24:42.118615 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0421 18:24:42.129683 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0421 18:24:42.146936 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0421 18:24:42.163535 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0421 18:24:42.172663 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0421 18:24:42.182684 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0421 18:24:42.201897 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0421 18:24:44.428966 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0421 18:24:54.318016 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0421 18:25:33.487670 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0421 18:25:47.930775 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0421 18:25:48.124729 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:25:48.159951 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:25:48.196055 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:25:48.463946 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0421 18:25:48.764329 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:25:48.799462 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:25:48.866098 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0421 18:25:48.884011 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:25:49.026158 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0421 18:26:27.270709 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.104.188.147"} I0421 18:26:27.277052 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.99.223.135"} I0421 18:26:27.305731 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.96.129.16"} I0421 18:26:27.322647 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.100.209.114"} I0421 18:26:27.331412 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.100.70.154"} I0421 18:26:27.339823 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.107.113.169"} I0421 18:26:27.384561 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0421 18:26:27.393027 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0421 18:26:27.423985 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0421 18:26:27.423988 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0421 18:26:27.435594 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0421 18:26:27.454328 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0421 18:26:27.465125 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.465172 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.466067 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.466104 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.466170 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.466193 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.466500 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.466529 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.466560 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.466587 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.466981 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.467019 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.467016 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.467072 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.467427 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.467458 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.467429 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.467478 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.467528 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.467552 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.468168 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.468202 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.468542 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.468567 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.468990 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.470127 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.469009 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.470493 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.470528 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.470510 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused W0421 18:26:27.469121 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused E0421 18:26:27.470566 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.100.70.154:443: connect: connection refused I0421 18:26:37.894530 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.99.196.121"} I0421 18:26:37.903387 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.109.79.233"} I0421 18:26:42.018200 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.99.178.70"} I0421 18:26:44.713719 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.103.162.249"} I0421 18:26:49.383853 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.96.200.189"} I0421 18:26:50.584120 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.110.56.190"} I0421 18:26:57.461331 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0421 18:26:57.625445 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.101.58.4"} I0421 18:27:38.235670 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.104.191.158"} I0421 18:27:38.260447 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0421 18:30:48.656528 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.97.187.81"} I0421 18:31:21.981664 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.105.38.156"} I0421 18:33:12.781056 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0421 18:33:12.785362 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.804198 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0421 18:33:12.812002 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.821071 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.827787 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.837415 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.851397 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.860119 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.870752 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.892008 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.902765 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.923541 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.935160 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:12.959113 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:13.002841 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:13.089439 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:13.131362 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:13.220659 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0421 18:33:17.884533 1 trace.go:236] Trace[1825557261]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a3138173-8f63-47a0-a07e-527ba0a98a28,client:10.0.0.17,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (21-Apr-2026 18:33:17.175) (total time: 709ms): Trace[1825557261]: ["GuaranteedUpdate etcd3" audit-id:a3138173-8f63-47a0-a07e-527ba0a98a28,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 709ms (18:33:17.175) Trace[1825557261]: ---"Txn call completed" 708ms (18:33:17.884)] Trace[1825557261]: [709.325953ms] [709.325953ms] END I0421 18:33:53.577401 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0421 18:33:53.588544 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0421 18:34:26.567419 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.103.15.37"} I0421 18:34:27.667208 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.98.102.221"} I0421 18:35:01.373885 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.106.79.46"} I0421 18:39:33.847934 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.97.150.250"} I0421 18:46:23.584875 1 trace.go:236] Trace[1461784539]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4f09ef88-6852-469d-b7d8-a29cd1971b65,client:199.19.213.191,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (21-Apr-2026 18:46:22.646) (total time: 938ms): Trace[1461784539]: ["GuaranteedUpdate etcd3" audit-id:4f09ef88-6852-469d-b7d8-a29cd1971b65,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 938ms (18:46:22.646) Trace[1461784539]: ---"Txn call completed" 937ms (18:46:23.584)] Trace[1461784539]: [938.559413ms] [938.559413ms] END I0421 18:46:23.587275 1 trace.go:236] Trace[1043164714]: "Get" accept:application/json,audit-id:22468e2e-e76c-43c7-863b-943442146d4f,client:199.19.213.191,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/sh.helm.release.v1.pxc-operator.v1,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (21-Apr-2026 18:46:22.563) (total time: 1024ms): Trace[1043164714]: ---"About to write a response" 1021ms (18:46:23.584) Trace[1043164714]: [1.024182282s] [1.024182282s] END I0421 18:46:23.589778 1 trace.go:236] Trace[239389897]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.191,type:*v1.Endpoints,resource:apiServerIPInfo (21-Apr-2026 18:46:22.541) (total time: 1048ms): Trace[239389897]: ---"Transaction prepared" 1042ms (18:46:23.584) Trace[239389897]: [1.048434393s] [1.048434393s] END I0421 18:46:23.595400 1 trace.go:236] Trace[747827714]: "List" accept:application/json, */*,audit-id:f99f66a9-dcfa-46f0-b6a4-f7c0bbbc48bb,client:199.19.213.191,protocol:HTTP/2.0,resource:events,scope:namespace,url:/api/v1/namespaces/openstack/events,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (21-Apr-2026 18:46:22.586) (total time: 1008ms): Trace[747827714]: ["List(recursive=true) etcd3" audit-id:f99f66a9-dcfa-46f0-b6a4-f7c0bbbc48bb,key:/events/openstack,resourceVersion:,resourceVersionMatch:,limit:500,continue: 1008ms (18:46:22.586)] Trace[747827714]: [1.008824081s] [1.008824081s] END