I0626 02:07:07.818890       1 options.go:220] external host was not specified, using 199.19.213.240
I0626 02:07:07.819784       1 server.go:148] Version: v1.28.13
I0626 02:07:07.819836       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0626 02:07:08.172640       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0626 02:07:08.180736       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0626 02:07:08.180760       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0626 02:07:08.181045       1 instance.go:298] Using reconciler: lease
I0626 02:07:08.744423       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0626 02:07:08.744510       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0626 02:07:08.971675       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0626 02:07:08.971842       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0626 02:07:09.447466       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0626 02:07:09.462909       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0626 02:07:09.463043       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.463070       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.463625       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0626 02:07:09.463663       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0626 02:07:09.464592       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0626 02:07:09.465385       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0626 02:07:09.465428       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0626 02:07:09.465445       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0626 02:07:09.467211       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0626 02:07:09.467256       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0626 02:07:09.468190       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0626 02:07:09.468233       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.468249       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.468855       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0626 02:07:09.468899       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.468953       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0626 02:07:09.469472       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0626 02:07:09.470936       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0626 02:07:09.470978       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.470995       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.471443       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0626 02:07:09.471491       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.471507       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.472135       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0626 02:07:09.472174       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0626 02:07:09.473469       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0626 02:07:09.473511       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.473526       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.473860       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0626 02:07:09.473900       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.473916       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.475876       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0626 02:07:09.475927       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.475965       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.476981       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0626 02:07:09.477821       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0626 02:07:09.477862       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.477877       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.481643       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0626 02:07:09.481757       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0626 02:07:09.481781       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0626 02:07:09.482712       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0626 02:07:09.482759       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0626 02:07:09.482775       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0626 02:07:09.483286       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0626 02:07:09.483331       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0626 02:07:09.528872       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0626 02:07:09.528903       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0626 02:07:09.990751       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0626 02:07:09.990763       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0626 02:07:09.991142       1 secure_serving.go:213] Serving securely on [::]:6443
I0626 02:07:09.991134       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0626 02:07:09.991354       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0626 02:07:09.991454       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0626 02:07:09.991537       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0626 02:07:09.991582       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0626 02:07:09.991679       1 available_controller.go:423] Starting AvailableConditionController
I0626 02:07:09.991691       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0626 02:07:09.991915       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0626 02:07:09.991974       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0626 02:07:09.991986       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0626 02:07:09.992361       1 aggregator.go:164] waiting for initial CRD sync...
I0626 02:07:09.992693       1 controller.go:116] Starting legacy_token_tracking_controller
I0626 02:07:09.992710       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0626 02:07:09.992740       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0626 02:07:09.992751       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0626 02:07:09.992788       1 controller.go:78] Starting OpenAPI AggregationController
I0626 02:07:09.992868       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0626 02:07:09.992933       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0626 02:07:09.993257       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0626 02:07:09.993296       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0626 02:07:09.993304       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0626 02:07:09.993780       1 controller.go:134] Starting OpenAPI controller
I0626 02:07:09.993832       1 controller.go:85] Starting OpenAPI V3 controller
I0626 02:07:09.993868       1 naming_controller.go:291] Starting NamingConditionController
I0626 02:07:09.993894       1 establishing_controller.go:76] Starting EstablishingController
I0626 02:07:09.993915       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0626 02:07:09.993934       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0626 02:07:09.993955       1 crd_finalizer.go:266] Starting CRDFinalizer
I0626 02:07:10.016963       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0626 02:07:10.017090       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0626 02:07:10.017131       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0626 02:07:10.072912       1 shared_informer.go:318] Caches are synced for node_authorizer
E0626 02:07:10.082694       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0626 02:07:10.091550       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0626 02:07:10.091567       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0626 02:07:10.091779       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0626 02:07:10.092187       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0626 02:07:10.092764       1 shared_informer.go:318] Caches are synced for configmaps
I0626 02:07:10.092810       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0626 02:07:10.093334       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0626 02:07:10.093377       1 aggregator.go:166] initial CRD sync complete...
I0626 02:07:10.093389       1 autoregister_controller.go:141] Starting autoregister controller
I0626 02:07:10.093397       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0626 02:07:10.093406       1 cache.go:39] Caches are synced for autoregister controller
I0626 02:07:10.097273       1 controller.go:624] quota admission added evaluator for: namespaces
I0626 02:07:10.288432       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0626 02:07:11.004161       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0626 02:07:11.009095       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0626 02:07:11.009110       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0626 02:07:11.641770       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0626 02:07:11.701817       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0626 02:07:11.810147       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0626 02:07:11.818798       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.240]
I0626 02:07:11.820893       1 controller.go:624] quota admission added evaluator for: endpoints
I0626 02:07:11.826628       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0626 02:07:13.315536       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0626 02:07:13.327040       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0626 02:07:13.400468       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0626 02:07:13.590971       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0626 02:07:18.260947       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0626 02:07:18.361094       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0626 02:07:50.798668       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0626 02:07:50.825820       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 02:07:50.825870       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 02:07:50.852189       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 02:07:50.882028       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0626 02:07:50.894791       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 02:07:50.894953       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0626 02:07:50.932956       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0626 02:07:50.944177       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0626 02:07:50.986835       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0626 02:07:51.024627       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0626 02:07:51.024684       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0626 02:07:51.084856       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 02:07:51.084984       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 02:07:51.116853       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 02:07:51.220164       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:51.311769       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:51.469074       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0626 02:07:51.469131       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0626 02:07:51.494524       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:51.531136       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:51.563896       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:52.252768       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:52.260977       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:52.353101       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0626 02:07:58.084363       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0626 02:07:58.899457       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 02:07:58.905907       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 02:07:59.294107       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 02:07:59.492597       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 02:07:59.703440       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 02:07:59.923870       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 02:08:00.094586       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 02:08:00.309060       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 02:08:00.902025       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0626 02:08:02.500460       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0626 02:08:02.940485       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0626 02:08:03.417850       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0626 02:08:03.418003       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0626 02:08:06.857031       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0626 02:08:15.807093       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.110.201.52"}
W0626 02:08:15.840329       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.110.201.52:9443: connect: connection refused
E0626 02:08:15.840374       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.110.201.52:9443: connect: connection refused
I0626 02:08:31.844659       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0626 02:08:31.857876       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 02:08:31.888031       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 02:08:31.913785       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0626 02:08:31.919710       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.105.27.147"}
I0626 02:08:31.930997       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.101.241.99"}
I0626 02:08:31.962255       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 02:08:31.997125       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0626 02:08:43.176187       1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io
I0626 02:08:48.108032       1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io
I0626 02:09:06.151313       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.96.255.9"}
I0626 02:09:06.160570       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.110.91.239"}
I0626 02:09:06.172029       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.100.17.154"}
I0626 02:09:06.180858       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.102.106.6"}
I0626 02:09:12.697983       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.718968       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.737694       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.754466       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.777970       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.796818       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.818562       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.844231       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.865180       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.882286       1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager
I0626 02:09:12.904879       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.958686       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:12.985306       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:14.265010       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0626 02:09:18.515587       1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io
I0626 02:09:18.580775       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.110.82.178"}
I0626 02:09:18.612335       1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io
I0626 02:09:20.813947       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0626 02:09:20.852118       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0626 02:09:21.547176       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager
I0626 02:09:21.547246       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager
I0626 02:09:21.547298       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0626 02:09:28.502242       1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com
I0626 02:09:32.668462       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.104.146.12"}
I0626 02:09:32.946172       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
I0626 02:09:33.057084       1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy
I0626 02:09:33.214542       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.106.17.83"}
I0626 02:09:33.229406       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.107.169.238"}
I0626 02:11:00.946840       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.100.129.68"}
I0626 02:11:03.011894       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.102.5.212"}
I0626 02:11:03.898575       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.109.173.107"}
I0626 02:11:12.418027       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.109.143.70"}
I0626 02:11:12.425415       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.108.230.70"}
E0626 02:11:47.901152       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:11:47.901195       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:11:47.901297       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.04µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 02:11:47.902851       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:11:47.902954       1 trace.go:236] Trace[1990027634]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:01b2696e-d6cc-4327-89c3-41d3b1b27b12,client:10.0.0.20,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:11:42.902) (total time: 5000ms):
Trace[1990027634]: ["GuaranteedUpdate etcd3" audit-id:01b2696e-d6cc-4327-89c3-41d3b1b27b12,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (02:11:42.902)
Trace[1990027634]:  ---"Txn call failed" err:context canceled 4997ms (02:11:47.901)]
Trace[1990027634]: [5.00076633s] [5.00076633s] END
E0626 02:11:47.903181       1 timeout.go:142] post-timeout activity - time-elapsed: 1.977843ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0626 02:11:48.034654       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
I0626 02:11:48.034884       1 trace.go:236] Trace[1037946611]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:25e226aa-ae38-4afa-8e19-a43c03ffef41,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:11:43.035) (total time: 4999ms):
Trace[1037946611]: [4.999773337s] [4.999773337s] END
E0626 02:11:48.035249       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s" audit-ID="25e226aa-ae38-4afa-8e19-a43c03ffef41"
E0626 02:11:48.035292       1 timeout.go:142] post-timeout activity - time-elapsed: 6.07µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 02:11:48.245644       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:11:48.245656       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.57µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 02:11:48.245689       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:11:48.247001       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:11:48.247106       1 trace.go:236] Trace[1802882014]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b4965ad3-ef98-49db-a081-d14793bfbad0,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:11:43.245) (total time: 5001ms):
Trace[1802882014]: ["GuaranteedUpdate etcd3" audit-id:b4965ad3-ef98-49db-a081-d14793bfbad0,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:11:43.245)
Trace[1802882014]:  ---"Txn call failed" err:context canceled 4998ms (02:11:48.245)]
Trace[1802882014]: [5.001244407s] [5.001244407s] END
E0626 02:11:48.247267       1 timeout.go:142] post-timeout activity - time-elapsed: 2.081942ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
I0626 02:11:48.600160       1 trace.go:236] Trace[80224255]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:073b93d4-a35e-404e-b35a-e79ae6143dda,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 02:11:42.736) (total time: 5863ms):
Trace[80224255]: ["GuaranteedUpdate etcd3" audit-id:073b93d4-a35e-404e-b35a-e79ae6143dda,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 5863ms (02:11:42.736)
Trace[80224255]:  ---"Txn call completed" 5862ms (02:11:48.599)]
Trace[80224255]: [5.863304969s] [5.863304969s] END
I0626 02:11:48.802925       1 trace.go:236] Trace[2046844226]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:555b5b10-8b61-4f39-83e5-b1fb157fdcb6,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:11:45.815) (total time: 2987ms):
Trace[2046844226]: ["GuaranteedUpdate etcd3" audit-id:555b5b10-8b61-4f39-83e5-b1fb157fdcb6,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2987ms (02:11:45.815)
Trace[2046844226]:  ---"Txn call completed" 2985ms (02:11:48.802)]
Trace[2046844226]: [2.987300337s] [2.987300337s] END
I0626 02:11:48.803488       1 trace.go:236] Trace[896548282]: "Update" accept:application/json, */*,audit-id:5d926981-13b0-4582-bb11-c5aa24cac831,client:10.0.0.62,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:11:44.115) (total time: 4688ms):
Trace[896548282]: ["GuaranteedUpdate etcd3" audit-id:5d926981-13b0-4582-bb11-c5aa24cac831,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4688ms (02:11:44.115)
Trace[896548282]:  ---"Txn call completed" 4687ms (02:11:48.803)]
Trace[896548282]: [4.688383888s] [4.688383888s] END
I0626 02:11:48.828298       1 trace.go:236] Trace[1082433369]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6182a1d7-e820-4579-a970-b425867b45a2,client:10.0.0.51,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:11:45.897) (total time: 2930ms):
Trace[1082433369]: ---"About to write a response" 2930ms (02:11:48.827)
Trace[1082433369]: [2.930532236s] [2.930532236s] END
I0626 02:11:48.829134       1 trace.go:236] Trace[1389024914]: "Get" accept:application/json, */*,audit-id:18d7d724-fc15-4f20-8502-7d5e0e095b13,client:199.19.213.240,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (26-Jun-2026 02:11:44.497) (total time: 4331ms):
Trace[1389024914]: ---"About to write a response" 4331ms (02:11:48.828)
Trace[1389024914]: [4.331817573s] [4.331817573s] END
I0626 02:11:48.829608       1 trace.go:236] Trace[980888290]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e58da6c6-c893-475c-b87e-6b3fe7841fef,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:11:44.088) (total time: 4741ms):
Trace[980888290]: ---"About to write a response" 4740ms (02:11:48.829)
Trace[980888290]: [4.741053648s] [4.741053648s] END
I0626 02:11:48.829856       1 trace.go:236] Trace[1013265498]: "Get" accept:application/json, */*,audit-id:96732793-0894-45b4-a072-c07bf96303b8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:11:43.037) (total time: 5792ms):
Trace[1013265498]: ---"About to write a response" 5791ms (02:11:48.829)
Trace[1013265498]: [5.792020519s] [5.792020519s] END
I0626 02:11:48.830063       1 trace.go:236] Trace[855076385]: "Get" accept:application/json, */*,audit-id:610f599a-745d-4454-b6be-9658501203e7,client:10.0.0.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:11:42.749) (total time: 6080ms):
Trace[855076385]: ---"About to write a response" 6080ms (02:11:48.830)
Trace[855076385]: [6.080105824s] [6.080105824s] END
I0626 02:11:48.830093       1 trace.go:236] Trace[1167690306]: "Get" accept:application/json, */*,audit-id:f423fb52-bda2-46cb-8978-71ffc26d222c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:11:43.618) (total time: 5211ms):
Trace[1167690306]: ---"About to write a response" 5211ms (02:11:48.829)
Trace[1167690306]: [5.211247553s] [5.211247553s] END
I0626 02:11:48.830441       1 trace.go:236] Trace[1167974914]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c83bd984-c422-4f85-bc5d-1a0261be248b,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:11:48.246) (total time: 584ms):
Trace[1167974914]: ---"About to write a response" 584ms (02:11:48.830)
Trace[1167974914]: [584.278349ms] [584.278349ms] END
I0626 02:11:48.836258       1 trace.go:236] Trace[535116914]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d96abbe9-6236-40e1-9626-51836b7d8f90,client:199.19.213.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18bc7fa25939d9f6,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:11:42.790) (total time: 6045ms):
Trace[535116914]: ["GuaranteedUpdate etcd3" audit-id:d96abbe9-6236-40e1-9626-51836b7d8f90,key:/events/auth-system/keycloak-0.18bc7fa25939d9f6,type:*core.Event,resource:events 6045ms (02:11:42.791)
Trace[535116914]:  ---"initial value restored" 6037ms (02:11:48.828)]
Trace[535116914]: [6.045273796s] [6.045273796s] END
I0626 02:11:48.837787       1 trace.go:236] Trace[1630806849]: "Get" accept:application/json, */*,audit-id:fe7ed3a4-9295-4032-8554-96b978c3a524,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:11:44.089) (total time: 4748ms):
Trace[1630806849]: ---"About to write a response" 4748ms (02:11:48.837)
Trace[1630806849]: [4.748674578s] [4.748674578s] END
I0626 02:11:48.838735       1 trace.go:236] Trace[789813350]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:238f6988-aeeb-476e-814e-31cc17889778,client:10.0.0.20,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:11:47.902) (total time: 936ms):
Trace[789813350]: ---"About to write a response" 936ms (02:11:48.838)
Trace[789813350]: [936.273247ms] [936.273247ms] END
E0626 02:12:23.183975       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:23.184296       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:23.185197       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:23.186427       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:23.186539       1 trace.go:236] Trace[1421740047]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c089e792-4f22-4b4b-9827-0f1466497108,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:12:18.184) (total time: 5002ms):
Trace[1421740047]: [5.002430457s] [5.002430457s] END
E0626 02:12:23.186721       1 timeout.go:142] post-timeout activity - time-elapsed: 2.863916ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 02:12:24.013029       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:24.013059       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:24.013081       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.17µs, panicked: false, err: context deadline exceeded, panic-reason: <nil>
E0626 02:12:24.016431       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:24.016495       1 trace.go:236] Trace[1060404517]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2be15394-b634-4718-bf75-0f4a0f5684a2,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:12:19.012) (total time: 5003ms):
Trace[1060404517]: ["GuaranteedUpdate etcd3" audit-id:2be15394-b634-4718-bf75-0f4a0f5684a2,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (02:12:19.012)
Trace[1060404517]:  ---"Txn call failed" err:context deadline exceeded 4999ms (02:12:24.012)]
Trace[1060404517]: [5.003588198s] [5.003588198s] END
E0626 02:12:24.016654       1 timeout.go:142] post-timeout activity - time-elapsed: 3.533345ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 02:12:24.031083       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:24.031100       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:24.031303       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 147.371µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 02:12:24.032192       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:24.032776       1 trace.go:236] Trace[976043402]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a45fd6f0-373e-4dc5-92dd-1ab7feb6ffbc,client:10.0.0.20,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:12:19.032) (total time: 4999ms):
Trace[976043402]: ["GuaranteedUpdate etcd3" audit-id:a45fd6f0-373e-4dc5-92dd-1ab7feb6ffbc,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (02:12:19.032)
Trace[976043402]:  ---"Txn call failed" err:context canceled 4997ms (02:12:24.031)]
Trace[976043402]: [4.999952557s] [4.999952557s] END
E0626 02:12:24.032935       1 timeout.go:142] post-timeout activity - time-elapsed: 1.811643ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0626 02:12:24.038438       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 02:12:24.038534       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:24.039824       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:24.039965       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0626 02:12:24.040741       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
I0626 02:12:24.040938       1 trace.go:236] Trace[1388824433]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9adeba09-ec98-46e2-9f58-2384349e1c74,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:12:19.038) (total time: 5002ms):
Trace[1388824433]: [5.002036029s] [5.002036029s] END
E0626 02:12:24.041012       1 timeout.go:142] post-timeout activity - time-elapsed: 2.35952ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 02:12:24.041078       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:24.043056       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:24.043085       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:24.044224       1 trace.go:236] Trace[1398366621]: "Get" accept:application/json, */*,audit-id:f074d78d-9f85-4e5f-b9b6-f94acbfb21ef,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:19.040) (total time: 5003ms):
Trace[1398366621]: [5.0036628s] [5.0036628s] END
E0626 02:12:24.044552       1 timeout.go:142] post-timeout activity - time-elapsed: 3.782687ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 02:12:25.637308       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 02:12:25.637495       1 trace.go:236] Trace[957269138]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1018cbe2-92be-4147-b1b2-0429b830d9bd,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (26-Jun-2026 02:12:18.632) (total time: 7004ms):
Trace[957269138]: ["GuaranteedUpdate etcd3" audit-id:1018cbe2-92be-4147-b1b2-0429b830d9bd,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (02:12:18.632)
Trace[957269138]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:12:25.635)]
Trace[957269138]: [7.00475266s] [7.00475266s] END
E0626 02:12:25.918807       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 02:12:25.919018       1 trace.go:236] Trace[318619331]: "Update" accept:application/json, */*,audit-id:fa7accaf-1a2c-4c12-bc18-21e1242eafcf,client:10.0.0.62,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (26-Jun-2026 02:12:18.916) (total time: 7002ms):
Trace[318619331]: ["GuaranteedUpdate etcd3" audit-id:fa7accaf-1a2c-4c12-bc18-21e1242eafcf,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:12:18.916)
Trace[318619331]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:12:25.918)]
Trace[318619331]: [7.002708981s] [7.002708981s] END
E0626 02:12:26.035323       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 02:12:26.035729       1 trace.go:236] Trace[2030751577]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:464916cc-7928-4ecd-837c-3c38905edeb7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:12:19.032) (total time: 7003ms):
Trace[2030751577]: ["GuaranteedUpdate etcd3" audit-id:464916cc-7928-4ecd-837c-3c38905edeb7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:12:19.032)
Trace[2030751577]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:12:26.035)]
Trace[2030751577]: [7.003043688s] [7.003043688s] END
E0626 02:12:26.036444       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0626 02:12:26.631919       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0626 02:12:26.632605       1 trace.go:236] Trace[1011803796]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d988b433-8346-456c-8e79-465af7f6c2ef,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:12:19.629) (total time: 7003ms):
Trace[1011803796]: ["GuaranteedUpdate etcd3" audit-id:d988b433-8346-456c-8e79-465af7f6c2ef,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:12:19.629)
Trace[1011803796]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:12:26.631)]
Trace[1011803796]: [7.003371094s] [7.003371094s] END
E0626 02:12:28.183693       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:28.183764       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:28.185264       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:28.185313       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:28.186484       1 trace.go:236] Trace[433025375]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:30a3009a-0cde-4073-ae7b-20bdf541766a,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:12:25.184) (total time: 3001ms):
Trace[433025375]: [3.001464847s] [3.001464847s] END
E0626 02:12:28.186649       1 timeout.go:142] post-timeout activity - time-elapsed: 2.747036ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0626 02:12:28.917492       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:28.917567       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:28.920039       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:28.920075       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:28.921354       1 trace.go:236] Trace[578143360]: "Get" accept:application/json, */*,audit-id:d058c3c0-9ee5-42a1-a1cd-ac787f68ad83,client:10.0.0.62,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:25.921) (total time: 2999ms):
Trace[578143360]: [2.999540881s] [2.999540881s] END
E0626 02:12:28.921495       1 timeout.go:142] post-timeout activity - time-elapsed: 1.401239ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0626 02:12:29.003511       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:29.003600       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.007482       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.007577       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:29.008862       1 trace.go:236] Trace[1794357036]: "Get" accept:application/json, */*,audit-id:98dcdeb9-058e-4373-b049-db27626d9574,client:10.0.0.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:19.003) (total time: 10005ms):
Trace[1794357036]: [10.005595124s] [10.005595124s] END
E0626 02:12:29.009154       1 timeout.go:142] post-timeout activity - time-elapsed: 5.621045ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
E0626 02:12:29.017193       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0626 02:12:29.017362       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.018733       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.018816       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:29.020010       1 trace.go:236] Trace[389498579]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4b1a2d26-1c85-424b-a7da-f45ab9dc6470,client:10.0.0.51,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:24.016) (total time: 5003ms):
Trace[389498579]: [5.003140595s] [5.003140595s] END
E0626 02:12:29.020233       1 timeout.go:142] post-timeout activity - time-elapsed: 3.287884ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: <nil>
E0626 02:12:29.033070       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
I0626 02:12:29.033386       1 trace.go:236] Trace[49424961]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0ac86946-9124-4b50-bb6e-e55f7a3a394f,client:10.0.0.20,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:24.032) (total time: 5001ms):
Trace[49424961]: [5.0012001s] [5.0012001s] END
E0626 02:12:29.034034       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:29.034183       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.034298       1 timeout.go:142] post-timeout activity - time-elapsed: 7.37µs, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0626 02:12:29.034301       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io?timeout=5s" audit-ID="0ac86946-9124-4b50-bb6e-e55f7a3a394f"
E0626 02:12:29.036019       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.036069       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:29.037121       1 trace.go:236] Trace[1018876552]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:41e2d9f1-f7af-4c47-b7a4-518bb041dce3,client:10.0.0.51,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:12:19.907) (total time: 9129ms):
Trace[1018876552]: [9.129662302s] [9.129662302s] END
E0626 02:12:29.037210       1 timeout.go:142] post-timeout activity - time-elapsed: 3.210672ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: <nil>
E0626 02:12:29.038610       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:29.038673       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.039976       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.039997       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0626 02:12:29.040251       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:29.041382       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.041406       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
I0626 02:12:29.041457       1 trace.go:236] Trace[2019403189]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c8693f25-4b55-4819-a0e8-ac3e79efd5aa,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (26-Jun-2026 02:12:26.041) (total time: 2999ms):
Trace[2019403189]: [2.999999837s] [2.999999837s] END
E0626 02:12:29.041522       1 timeout.go:142] post-timeout activity - time-elapsed: 2.846178ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0626 02:12:29.043004       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:29.043027       1 trace.go:236] Trace[89029977]: "Get" accept:application/json, */*,audit-id:b044d345-8e8a-4ce5-a1c5-0a6065e318d2,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:26.042) (total time: 3000ms):
Trace[89029977]: [3.00092267s] [3.00092267s] END
E0626 02:12:29.043074       1 timeout.go:142] post-timeout activity - time-elapsed: 2.809038ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0626 02:12:29.045487       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:29.045519       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.047451       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.047472       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:29.048583       1 trace.go:236] Trace[1831953864]: "Get" accept:application/json, */*,audit-id:160e1c90-9b59-49aa-817e-1e503a27881a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:12:19.045) (total time: 10003ms):
Trace[1831953864]: [10.003379166s] [10.003379166s] END
E0626 02:12:29.048641       1 timeout.go:142] post-timeout activity - time-elapsed: 3.107201ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0626 02:12:29.348311       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0626 02:12:29.348422       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.349389       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.349529       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0626 02:12:29.350761       1 trace.go:236] Trace[379086478]: "Get" accept:application/json, */*,audit-id:c3fdab1e-dbd8-4638-9639-a41ca4512293,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (26-Jun-2026 02:12:19.348) (total time: 10002ms):
Trace[379086478]: [10.002587802s] [10.002587802s] END
E0626 02:12:29.350996       1 timeout.go:142] post-timeout activity - time-elapsed: 2.699357ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
I0626 02:12:29.355771       1 trace.go:236] Trace[217789803]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7fb6dd9d-f29b-4803-92ad-6fa39caa90e5,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:12:26.037) (total time: 3318ms):
Trace[217789803]: ["GuaranteedUpdate etcd3" audit-id:7fb6dd9d-f29b-4803-92ad-6fa39caa90e5,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3318ms (02:12:26.037)
Trace[217789803]:  ---"Txn call completed" 3316ms (02:12:29.355)]
Trace[217789803]: [3.318341516s] [3.318341516s] END
E0626 02:12:29.356645       1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again"
I0626 02:12:29.358847       1 trace.go:236] Trace[530443730]: "Get" accept:application/json, */*,audit-id:ee3f6601-9c17-4387-b25d-b7d6b2741d1d,client:199.19.213.240,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (26-Jun-2026 02:12:18.499) (total time: 10858ms):
Trace[530443730]: ---"About to write a response" 10858ms (02:12:29.358)
Trace[530443730]: [10.858888916s] [10.858888916s] END
I0626 02:12:29.358898       1 trace.go:236] Trace[687108176]: "Get" accept:application/json, */*,audit-id:91f6fe63-df33-47f8-923f-87b7666d22b5,client:10.0.0.239,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (26-Jun-2026 02:12:22.058) (total time: 7300ms):
Trace[687108176]: ---"About to write a response" 7300ms (02:12:29.358)
Trace[687108176]: [7.300863376s] [7.300863376s] END
I0626 02:12:29.358980       1 trace.go:236] Trace[1660223568]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:883a8d25-247b-4e36-8ff7-779dfb13d0cb,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (26-Jun-2026 02:12:25.639) (total time: 3719ms):
Trace[1660223568]: ---"About to write a response" 3718ms (02:12:29.358)
Trace[1660223568]: [3.71900194s] [3.71900194s] END
I0626 02:12:29.359056       1 trace.go:236] Trace[1426277569]: "Get" accept:application/json, */*,audit-id:a5095c2c-9b4e-4576-8f65-1a1bf99c87f4,client:10.0.0.202,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (26-Jun-2026 02:12:19.983) (total time: 9375ms):
Trace[1426277569]: ---"About to write a response" 9375ms (02:12:29.359)
Trace[1426277569]: [9.375700799s] [9.375700799s] END
I0626 02:12:29.361705       1 trace.go:236] Trace[478778312]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8e88bb3e-8f27-4d5e-94bf-851e54332451,client:199.19.213.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (26-Jun-2026 02:12:26.635) (total time: 2726ms):
Trace[478778312]: ["GuaranteedUpdate etcd3" audit-id:8e88bb3e-8f27-4d5e-94bf-851e54332451,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2726ms (02:12:26.635)
Trace[478778312]:  ---"Txn call completed" 2723ms (02:12:29.359)]
Trace[478778312]: [2.726597383s] [2.726597383s] END
E0626 02:12:29.366179       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0626 02:12:29.366204       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0626 02:12:29.366220       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 4.91µs, panicked: false, err: context canceled, panic-reason: <nil>
E0626 02:12:29.367434       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0626 02:12:29.367498       1 timeout.go:142] post-timeout activity - time-elapsed: 1.351938ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
I0626 02:12:29.371602       1 trace.go:236] Trace[1404099204]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9ca16785-69f9-40af-8e0b-60b770835ae2,client:199.19.213.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18bc7fa25939d9f6,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (26-Jun-2026 02:12:17.792) (total time: 11578ms):
Trace[1404099204]: ["GuaranteedUpdate etcd3" audit-id:9ca16785-69f9-40af-8e0b-60b770835ae2,key:/events/auth-system/keycloak-0.18bc7fa25939d9f6,type:*core.Event,resource:events 11578ms (02:12:17.792)
Trace[1404099204]:  ---"initial value restored" 11565ms (02:12:29.358)]
Trace[1404099204]: [11.578946976s] [11.578946976s] END
I0626 02:12:29.403453       1 trace.go:236] Trace[1930197188]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.240,type:*v1.Endpoints,resource:apiServerIPInfo (26-Jun-2026 02:12:21.815) (total time: 7587ms):
Trace[1930197188]: ---"initial value restored" 7548ms (02:12:29.364)
Trace[1930197188]: [7.587556669s] [7.587556669s] END
I0626 02:13:32.221966       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
I0626 02:13:34.108209       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0626 02:13:34.120117       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0626 02:13:34.128854       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0626 02:13:34.142181       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 02:13:34.160468       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 02:13:34.169096       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 02:13:34.178397       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0626 02:13:47.365572       1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io
I0626 02:14:26.526212       1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev
I0626 02:14:40.618326       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0626 02:14:40.777763       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:14:40.782228       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:14:40.862505       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:14:41.085156       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0626 02:14:41.327279       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:14:41.331359       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:14:41.384471       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0626 02:14:41.398737       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:14:41.583519       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0626 02:15:23.165402       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.103.83.156"}
I0626 02:15:23.179035       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.110.192.123"}
I0626 02:15:23.188790       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.96.188.96"}
I0626 02:15:23.196095       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.102.64.234"}
I0626 02:15:23.208240       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.107.2.210"}
I0626 02:15:23.218741       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.96.252.124"}
I0626 02:15:23.292881       1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com
I0626 02:15:23.317819       1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com
I0626 02:15:23.349741       1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com
I0626 02:15:23.387728       1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com
I0626 02:15:23.424695       1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com
W0626 02:15:23.434107       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.434152       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.434389       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.434417       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.434876       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.434909       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.435245       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.435268       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.435395       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.435428       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.435754       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.435789       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.435882       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.435897       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.435914       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436002       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.436109       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436138       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.436185       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436213       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.436287       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436304       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.436692       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436717       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.436841       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436879       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.436904       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.436923       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.437430       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.437458       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
W0626 02:15:23.440013       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
E0626 02:15:23.440048       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.124:443: connect: connection refused
I0626 02:15:37.980240       1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com
I0626 02:15:38.138338       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.96.112.31"}
I0626 02:16:28.322474       1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.103.217.89"}
I0626 02:16:28.338382       1 controller.go:624] quota admission added evaluator for: cronjobs.batch
I0626 02:19:11.800867       1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.97.85.199"}
I0626 02:19:11.809781       1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.105.236.214"}