I0628 19:50:55.586708 1 options.go:220] external host was not specified, using 199.204.45.77 I0628 19:50:55.587821 1 server.go:148] Version: v1.28.13 I0628 19:50:55.587837 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0628 19:50:56.076006 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0628 19:50:56.083582 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0628 19:50:56.083602 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0628 19:50:56.083871 1 instance.go:298] Using reconciler: lease I0628 19:50:56.127584 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0628 19:50:56.127752 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0628 19:50:56.369021 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0628 19:50:56.369251 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0628 19:50:56.801591 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0628 19:50:56.814428 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0628 19:50:56.814450 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.814455 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.815063 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0628 19:50:56.815074 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0628 19:50:56.816403 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0628 19:50:56.818303 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0628 19:50:56.818333 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0628 19:50:56.818340 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0628 19:50:56.820384 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0628 19:50:56.820402 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0628 19:50:56.821342 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0628 19:50:56.821358 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.821364 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.821979 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0628 19:50:56.821996 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.822063 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0628 19:50:56.822647 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0628 19:50:56.824220 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0628 19:50:56.824233 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.824237 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.824601 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0628 19:50:56.824613 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.824616 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.825221 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0628 19:50:56.825233 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0628 19:50:56.826527 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0628 19:50:56.826539 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.826543 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.826948 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0628 19:50:56.826961 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.826965 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.828749 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0628 19:50:56.828763 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.828767 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.829704 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0628 19:50:56.830632 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0628 19:50:56.830645 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.830649 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.833719 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0628 19:50:56.833734 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0628 19:50:56.833738 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0628 19:50:56.834410 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0628 19:50:56.834422 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0628 19:50:56.834426 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0628 19:50:56.834897 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0628 19:50:56.834910 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0628 19:50:56.869850 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0628 19:50:56.869884 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0628 19:50:57.253388 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0628 19:50:57.253398 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0628 19:50:57.253504 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0628 19:50:57.253850 1 secure_serving.go:213] Serving securely on [::]:6443 I0628 19:50:57.253970 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0628 19:50:57.254016 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0628 19:50:57.254066 1 controller.go:78] Starting OpenAPI AggregationController I0628 19:50:57.254110 1 controller.go:80] Starting OpenAPI V3 AggregationController I0628 19:50:57.254153 1 available_controller.go:423] Starting AvailableConditionController I0628 19:50:57.254166 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0628 19:50:57.254199 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0628 19:50:57.254230 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0628 19:50:57.254256 1 system_namespaces_controller.go:67] Starting system namespaces controller I0628 19:50:57.254285 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0628 19:50:57.254328 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0628 19:50:57.254379 1 aggregator.go:164] waiting for initial CRD sync... I0628 19:50:57.254403 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0628 19:50:57.254419 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0628 19:50:57.254525 1 gc_controller.go:78] Starting apiserver lease garbage collector I0628 19:50:57.254749 1 gc_controller.go:78] Starting apiserver lease garbage collector I0628 19:50:57.254199 1 controller.go:134] Starting OpenAPI controller I0628 19:50:57.255424 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0628 19:50:57.255438 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0628 19:50:57.255982 1 controller.go:116] Starting legacy_token_tracking_controller I0628 19:50:57.256008 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0628 19:50:57.256107 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0628 19:50:57.256237 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0628 19:50:57.258368 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0628 19:50:57.258731 1 controller.go:85] Starting OpenAPI V3 controller I0628 19:50:57.258771 1 naming_controller.go:291] Starting NamingConditionController I0628 19:50:57.258810 1 establishing_controller.go:76] Starting EstablishingController I0628 19:50:57.258829 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0628 19:50:57.258854 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0628 19:50:57.258870 1 crd_finalizer.go:266] Starting CRDFinalizer I0628 19:50:57.276438 1 shared_informer.go:318] Caches are synced for node_authorizer I0628 19:50:57.358700 1 apf_controller.go:379] Running API Priority and Fairness config worker I0628 19:50:57.358712 1 shared_informer.go:318] Caches are synced for crd-autoregister I0628 19:50:57.358721 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0628 19:50:57.358708 1 shared_informer.go:318] Caches are synced for configmaps I0628 19:50:57.358921 1 cache.go:39] Caches are synced for AvailableConditionController controller I0628 19:50:57.358721 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0628 19:50:57.358938 1 aggregator.go:166] initial CRD sync complete... I0628 19:50:57.359107 1 autoregister_controller.go:141] Starting autoregister controller I0628 19:50:57.359112 1 cache.go:32] Waiting for caches to sync for autoregister controller I0628 19:50:57.359117 1 cache.go:39] Caches are synced for autoregister controller I0628 19:50:57.358979 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0628 19:50:57.361226 1 controller.go:624] quota admission added evaluator for: namespaces I0628 19:50:57.421461 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0628 19:50:58.261643 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0628 19:50:58.316144 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0628 19:50:58.316167 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0628 19:50:58.823570 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0628 19:50:58.870359 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0628 19:50:58.974915 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0628 19:50:58.981853 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.77] I0628 19:50:58.982907 1 controller.go:624] quota admission added evaluator for: endpoints I0628 19:50:58.988284 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0628 19:51:00.125452 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0628 19:51:00.460151 1 controller.go:624] quota admission added evaluator for: deployments.apps I0628 19:51:00.793778 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0628 19:51:00.854336 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0628 19:51:04.818748 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0628 19:51:04.930597 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0628 19:51:12.359463 1 trace.go:236] Trace[300310437]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e608d45a-fbde-4e59-a709-0d4f372f0600,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-scheduler-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:51:11.673) (total time: 685ms): Trace[300310437]: ["GuaranteedUpdate etcd3" audit-id:e608d45a-fbde-4e59-a709-0d4f372f0600,key:/pods/kube-system/kube-scheduler-instance,type:*core.Pod,resource:pods 685ms (19:51:11.673) Trace[300310437]: ---"Txn call completed" 682ms (19:51:12.359)] Trace[300310437]: ---"Object stored in database" 683ms (19:51:12.359) Trace[300310437]: [685.642819ms] [685.642819ms] END I0628 19:51:12.360114 1 trace.go:236] Trace[1968536324]: "Get" accept:application/json, */*,audit-id:7184f66e-a001-4042-ba8f-4102b33699b7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:51:11.727) (total time: 632ms): Trace[1968536324]: ---"About to write a response" 632ms (19:51:12.359) Trace[1968536324]: [632.959875ms] [632.959875ms] END I0628 19:51:15.346463 1 trace.go:236] Trace[1878678597]: "Get" accept:application/json, */*,audit-id:741a6c9b-078c-4d4e-82d4-40dd443f9e97,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:51:14.368) (total time: 978ms): Trace[1878678597]: ---"About to write a response" 978ms (19:51:15.346) Trace[1878678597]: [978.389506ms] [978.389506ms] END I0628 19:51:15.346941 1 trace.go:236] Trace[1332895440]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7b71b73b-1c96-46ff-b6e8-03441bb4c8eb,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:51:14.773) (total time: 573ms): Trace[1332895440]: ---"About to write a response" 573ms (19:51:15.346) Trace[1332895440]: [573.373281ms] [573.373281ms] END I0628 19:51:15.347131 1 trace.go:236] Trace[1248592228]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:37b72f6e-d554-4e13-be43-cf8fe8ba88d3,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:51:14.379) (total time: 967ms): Trace[1248592228]: ---"About to write a response" 967ms (19:51:15.346) Trace[1248592228]: [967.187763ms] [967.187763ms] END I0628 19:51:15.347866 1 trace.go:236] Trace[1032935744]: "Get" accept:application/json, */*,audit-id:1f100853-a179-4417-a7b3-572ed8fabe7f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:51:14.380) (total time: 967ms): Trace[1032935744]: ---"About to write a response" 967ms (19:51:15.347) Trace[1032935744]: [967.337675ms] [967.337675ms] END I0628 19:51:26.077030 1 trace.go:236] Trace[223724869]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d7dd223b-f2cc-4cf8-b276-f72e729921fd,client:199.204.45.77,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/replicasets/coredns-67659f764b/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:PUT (28-Jun-2026 19:51:25.349) (total time: 727ms): Trace[223724869]: ["GuaranteedUpdate etcd3" audit-id:d7dd223b-f2cc-4cf8-b276-f72e729921fd,key:/replicasets/kube-system/coredns-67659f764b,type:*apps.ReplicaSet,resource:replicasets.apps 727ms (19:51:25.349)] Trace[223724869]: [727.426997ms] [727.426997ms] END I0628 19:51:26.077420 1 trace.go:236] Trace[899714169]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:44f0aff8-bb8b-4320-8668-25b08dcada10,client:199.204.45.77,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:POST (28-Jun-2026 19:51:25.347) (total time: 729ms): Trace[899714169]: ["Create etcd3" audit-id:44f0aff8-bb8b-4320-8668-25b08dcada10,key:/events/kube-system/coredns-67659f764b.18bd56a2ea8036fa,type:*core.Event,resource:events 728ms (19:51:25.348) Trace[899714169]: ---"Txn call succeeded" 728ms (19:51:26.077)] Trace[899714169]: [729.467878ms] [729.467878ms] END I0628 19:51:26.442003 1 trace.go:236] Trace[2137079475]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:74e93c45-98c6-4094-9a7f-7308f9aeb665,client:199.204.45.77,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/replicasets/coredns-7c96b6546b/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:PUT (28-Jun-2026 19:51:25.350) (total time: 1091ms): Trace[2137079475]: ["GuaranteedUpdate etcd3" audit-id:74e93c45-98c6-4094-9a7f-7308f9aeb665,key:/replicasets/kube-system/coredns-7c96b6546b,type:*apps.ReplicaSet,resource:replicasets.apps 1090ms (19:51:25.351) Trace[2137079475]: ---"Txn call completed" 1086ms (19:51:26.441)] Trace[2137079475]: [1.091092922s] [1.091092922s] END I0628 19:51:26.443117 1 trace.go:236] Trace[232047403]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:15ba4ecd-b914-4e16-aefa-c94f6c929cc7,client:199.204.45.77,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (28-Jun-2026 19:51:25.350) (total time: 1092ms): Trace[232047403]: ["GuaranteedUpdate etcd3" audit-id:15ba4ecd-b914-4e16-aefa-c94f6c929cc7,key:/deployments/kube-system/coredns,type:*apps.Deployment,resource:deployments.apps 1091ms (19:51:25.351) Trace[232047403]: ---"Txn call completed" 1086ms (19:51:26.441)] Trace[232047403]: [1.092112052s] [1.092112052s] END I0628 19:51:38.167831 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:51:38.217054 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0628 19:51:38.238410 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0628 19:51:38.271536 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:51:38.271586 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0628 19:51:38.403703 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0628 19:51:38.453002 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0628 19:51:38.586739 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0628 19:51:38.633964 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0628 19:51:38.634007 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0628 19:51:38.834133 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:51:38.834172 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:51:38.932744 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:51:39.031040 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:51:39.031080 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:51:39.050424 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:51:39.050536 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:51:39.065645 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.126760 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.160992 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.202856 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.219726 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.610013 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.636112 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:39.734375 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:51:42.843779 1 trace.go:236] Trace[1566717000]: "Update" accept:application/json, */*,audit-id:712d5b02-f8fa-4da8-9dd5-c9652af05534,client:199.204.45.77,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (28-Jun-2026 19:51:42.159) (total time: 684ms): Trace[1566717000]: ---"Conversion done" 24ms (19:51:42.189) Trace[1566717000]: ["GuaranteedUpdate etcd3" audit-id:712d5b02-f8fa-4da8-9dd5-c9652af05534,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 654ms (19:51:42.189) Trace[1566717000]: ---"Txn call completed" 606ms (19:51:42.805)] Trace[1566717000]: ---"Writing http response done" 36ms (19:51:42.843) Trace[1566717000]: [684.062409ms] [684.062409ms] END I0628 19:51:45.915356 1 trace.go:236] Trace[1941151040]: "Update" accept:application/json, */*,audit-id:1c48ad25-9b21-4776-a55a-fe81cc1c689c,client:199.204.45.77,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (28-Jun-2026 19:51:45.371) (total time: 543ms): Trace[1941151040]: ---"Conversion done" 20ms (19:51:45.399) Trace[1941151040]: ---"Writing http response done" 26ms (19:51:45.915) Trace[1941151040]: [543.775191ms] [543.775191ms] END I0628 19:51:45.934587 1 controller.go:624] quota admission added evaluator for: jobs.batch I0628 19:51:47.558099 1 trace.go:236] Trace[669012885]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e2377f80-f6cb-4339-90d1-4128662fbda4,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:POST (28-Jun-2026 19:51:46.216) (total time: 1341ms): Trace[669012885]: ["Create etcd3" audit-id:e2377f80-f6cb-4339-90d1-4128662fbda4,key:/pods/envoy-gateway-system/envoy-gateway-gateway-helm-certgen-8nnlq,type:*core.Pod,resource:pods 1338ms (19:51:46.219) Trace[669012885]: ---"Txn call succeeded" 1337ms (19:51:47.557)] Trace[669012885]: [1.341180599s] [1.341180599s] END I0628 19:51:50.570104 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:51:50.583737 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:51:50.592133 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:51:51.131170 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:51:51.176121 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:51:51.367588 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:51:51.574697 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:51:52.984446 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:51:53.593293 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:51:54.196004 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0628 19:51:54.300008 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0628 19:51:54.300044 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0628 19:51:54.564337 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:51:57.741998 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0628 19:52:03.270963 1 trace.go:236] Trace[1418325890]: "Update" accept:application/json, */*,audit-id:71c80552-1db3-4a1b-bfce-d3ab06d7d00b,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:52:02.632) (total time: 638ms): Trace[1418325890]: ["GuaranteedUpdate etcd3" audit-id:71c80552-1db3-4a1b-bfce-d3ab06d7d00b,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 638ms (19:52:02.632) Trace[1418325890]: ---"Txn call completed" 637ms (19:52:03.270)] Trace[1418325890]: [638.408306ms] [638.408306ms] END I0628 19:52:03.271463 1 trace.go:236] Trace[1900071236]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9db43b57-1468-484b-ba51-869eb07a6582,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-gateway-helm-certgen-8nnlq,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Jun-2026 19:52:02.685) (total time: 586ms): Trace[1900071236]: ---"About to write a response" 586ms (19:52:03.271) Trace[1900071236]: [586.266119ms] [586.266119ms] END I0628 19:52:07.159634 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.104.205.225"} W0628 19:52:07.195620 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.104.205.225:9443: connect: connection refused E0628 19:52:07.195673 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.104.205.225:9443: connect: connection refused I0628 19:52:21.214671 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0628 19:52:21.228026 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:52:21.254593 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:52:21.274189 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0628 19:52:21.291380 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.100.107.133"} I0628 19:52:21.300845 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.107.25.57"} I0628 19:52:21.327679 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:52:21.396102 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:52:33.325806 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0628 19:52:38.828940 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0628 19:52:58.080581 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.98.1.50"} I0628 19:52:58.089762 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.110.9.78"} I0628 19:52:58.110193 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.101.148.40"} I0628 19:52:58.120146 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.108.116.110"} I0628 19:53:06.061481 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.091087 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.104939 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.129986 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.140473 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.159080 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.196126 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.272656 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.282818 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.294818 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0628 19:53:06.305010 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.313980 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:06.321762 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:07.553769 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:53:11.416229 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0628 19:53:11.416227 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0628 19:53:11.466013 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.105.153.115"} I0628 19:53:11.502187 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0628 19:53:13.848157 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0628 19:53:14.104112 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0628 19:53:15.043412 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0628 19:53:15.043458 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0628 19:53:15.043491 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0628 19:53:22.173762 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0628 19:53:24.388123 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.100.242.153"} I0628 19:53:24.761074 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0628 19:53:24.908837 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.97.117.70"} I0628 19:53:24.919934 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.101.171.101"} I0628 19:53:25.763510 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0628 19:53:29.941420 1 trace.go:236] Trace[1872982443]: "Update" accept:application/json, */*,audit-id:df3679cb-528f-4386-ae89-b2d08d05f2f4,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:53:27.403) (total time: 2537ms): Trace[1872982443]: ["GuaranteedUpdate etcd3" audit-id:df3679cb-528f-4386-ae89-b2d08d05f2f4,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2537ms (19:53:27.403) Trace[1872982443]: ---"Txn call completed" 2536ms (19:53:29.941)] Trace[1872982443]: [2.537854258s] [2.537854258s] END I0628 19:53:29.943125 1 trace.go:236] Trace[859564962]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3196c95c-d58f-4efc-a951-9a4ac8e77e54,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-haproxy-0/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:53:27.404) (total time: 2537ms): Trace[859564962]: ["GuaranteedUpdate etcd3" audit-id:3196c95c-d58f-4efc-a951-9a4ac8e77e54,key:/pods/openstack/percona-xtradb-haproxy-0,type:*core.Pod,resource:pods 2538ms (19:53:27.404) Trace[859564962]: ---"Txn call completed" 2530ms (19:53:29.941)] Trace[859564962]: ---"Object stored in database" 2531ms (19:53:29.941) Trace[859564962]: [2.537681015s] [2.537681015s] END I0628 19:53:31.998540 1 trace.go:236] Trace[1001013213]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:efae102a-78fb-4c8a-a67a-95c06cd88046,client:10.0.0.160,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:53:28.188) (total time: 3809ms): Trace[1001013213]: ["GuaranteedUpdate etcd3" audit-id:efae102a-78fb-4c8a-a67a-95c06cd88046,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 3809ms (19:53:28.188) Trace[1001013213]: ---"Txn call completed" 3808ms (19:53:31.998)] Trace[1001013213]: [3.809800126s] [3.809800126s] END E0628 19:53:32.461647 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0628 19:53:32.461748 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0628 19:53:32.462963 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0628 19:53:32.463959 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0628 19:53:32.464166 1 trace.go:236] Trace[11233379]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:08f4298b-3fc6-4195-ac88-09c082995cf7,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:53:27.458) (total time: 5005ms): Trace[11233379]: [5.005288338s] [5.005288338s] END E0628 19:53:32.464348 1 timeout.go:142] post-timeout activity - time-elapsed: 5.174581ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0628 19:53:32.808841 1 trace.go:236] Trace[1004179831]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2f9614df-0a5f-49f4-9aa5-7b42b590fd63,client:199.204.45.77,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/percona-xtradb-haproxy-replicas,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpoint-controller,verb:PUT (28-Jun-2026 19:53:29.943) (total time: 2865ms): Trace[1004179831]: ["GuaranteedUpdate etcd3" audit-id:2f9614df-0a5f-49f4-9aa5-7b42b590fd63,key:/services/endpoints/openstack/percona-xtradb-haproxy-replicas,type:*core.Endpoints,resource:endpoints 2865ms (19:53:29.943) Trace[1004179831]: ---"Txn call completed" 2864ms (19:53:32.808)] Trace[1004179831]: [2.865250281s] [2.865250281s] END I0628 19:53:32.809018 1 trace.go:236] Trace[1866764992]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b5ca787f-e347-43ce-985d-1b57a14ef9b6,client:199.204.45.77,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/openstack/endpointslices/percona-xtradb-haproxy-replicas-86tqq,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (28-Jun-2026 19:53:29.944) (total time: 2864ms): Trace[1866764992]: ["GuaranteedUpdate etcd3" audit-id:b5ca787f-e347-43ce-985d-1b57a14ef9b6,key:/endpointslices/openstack/percona-xtradb-haproxy-replicas-86tqq,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 2864ms (19:53:29.944) Trace[1866764992]: ---"Txn call completed" 2863ms (19:53:32.808)] Trace[1866764992]: [2.864633411s] [2.864633411s] END I0628 19:53:32.810199 1 trace.go:236] Trace[1890293738]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:be42f886-a5cf-429f-956b-00f952aa625c,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (28-Jun-2026 19:53:29.946) (total time: 2863ms): Trace[1890293738]: ["GuaranteedUpdate etcd3" audit-id:be42f886-a5cf-429f-956b-00f952aa625c,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 2863ms (19:53:29.946) Trace[1890293738]: ---"Txn call completed" 2862ms (19:53:32.809)] Trace[1890293738]: [2.863460812s] [2.863460812s] END I0628 19:53:32.810406 1 trace.go:236] Trace[633217935]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:44b2520b-5270-4943-a3f1-b7c560e92891,client:199.204.45.77,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/openstack/endpointslices/percona-xtradb-haproxy-8ltg7,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (28-Jun-2026 19:53:29.944) (total time: 2866ms): Trace[633217935]: ["GuaranteedUpdate etcd3" audit-id:44b2520b-5270-4943-a3f1-b7c560e92891,key:/endpointslices/openstack/percona-xtradb-haproxy-8ltg7,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 2865ms (19:53:29.944) Trace[633217935]: ---"Txn call completed" 2864ms (19:53:32.809)] Trace[633217935]: [2.866137545s] [2.866137545s] END I0628 19:53:32.810465 1 trace.go:236] Trace[87212127]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:53111bc3-6805-40c4-999b-69cf8a958701,client:10.0.0.143,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:53:29.406) (total time: 3403ms): Trace[87212127]: ["GuaranteedUpdate etcd3" audit-id:53111bc3-6805-40c4-999b-69cf8a958701,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 3403ms (19:53:29.406) Trace[87212127]: ---"Txn call completed" 3402ms (19:53:32.810)] Trace[87212127]: [3.403881039s] [3.403881039s] END I0628 19:53:32.808845 1 trace.go:236] Trace[1402846803]: "Update" accept:application/json, */*,audit-id:58fe1f2b-5ead-4609-8793-dcaaef6f6a87,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:53:29.241) (total time: 3566ms): Trace[1402846803]: ["GuaranteedUpdate etcd3" audit-id:58fe1f2b-5ead-4609-8793-dcaaef6f6a87,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3566ms (19:53:29.242) Trace[1402846803]: ---"Txn call completed" 3565ms (19:53:32.808)] Trace[1402846803]: [3.566801125s] [3.566801125s] END I0628 19:53:32.811275 1 trace.go:236] Trace[1840638251]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5beddfc1-673c-4f28-bf70-718ce84580f3,client:199.204.45.77,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/percona-xtradb-haproxy,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpoint-controller,verb:PUT (28-Jun-2026 19:53:29.944) (total time: 2866ms): Trace[1840638251]: ["GuaranteedUpdate etcd3" audit-id:5beddfc1-673c-4f28-bf70-718ce84580f3,key:/services/endpoints/openstack/percona-xtradb-haproxy,type:*core.Endpoints,resource:endpoints 2866ms (19:53:29.944) Trace[1840638251]: ---"Txn call completed" 2864ms (19:53:32.811)] Trace[1840638251]: [2.866564801s] [2.866564801s] END I0628 19:53:32.811278 1 trace.go:236] Trace[2100397333]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4e6c843a-c410-47ee-8022-758c99d95a07,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-37a27867-ceeb-4cbe-a0dc-96bde9391ce2,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Jun-2026 19:53:29.943) (total time: 2867ms): Trace[2100397333]: ---"About to write a response" 2867ms (19:53:32.811) Trace[2100397333]: [2.867241212s] [2.867241212s] END I0628 19:53:32.811592 1 trace.go:236] Trace[1030157377]: "Get" accept:application/json, */*,audit-id:3b665322-613c-4e65-b932-2eaa03df7fc3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:53:27.912) (total time: 4898ms): Trace[1030157377]: ---"About to write a response" 4898ms (19:53:32.811) Trace[1030157377]: [4.898807444s] [4.898807444s] END I0628 19:53:32.811620 1 trace.go:236] Trace[1807127629]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:90f6d171-d6b3-4cba-97f7-c89a7df5ce7a,client:10.0.0.160,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:53:30.653) (total time: 2158ms): Trace[1807127629]: ---"About to write a response" 2157ms (19:53:32.811) Trace[1807127629]: [2.158038088s] [2.158038088s] END I0628 19:53:32.812341 1 trace.go:236] Trace[147534281]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a2a8860f-1042-4d46-b758-77eb64130032,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:53:29.438) (total time: 3373ms): Trace[147534281]: ---"About to write a response" 3373ms (19:53:32.812) Trace[147534281]: [3.373779247s] [3.373779247s] END I0628 19:53:32.812412 1 trace.go:236] Trace[22657171]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3f1af883-8e14-46cf-8332-5c8d1d8a0028,client:199.204.45.77,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (28-Jun-2026 19:53:31.414) (total time: 1398ms): Trace[22657171]: ["Create etcd3" audit-id:3f1af883-8e14-46cf-8332-5c8d1d8a0028,key:/events/kube-system/kube-apiserver-instance.18bd56c04bc09c6b,type:*core.Event,resource:events 1397ms (19:53:31.415) Trace[22657171]: ---"Txn call succeeded" 1397ms (19:53:32.812)] Trace[22657171]: [1.398032536s] [1.398032536s] END I0628 19:53:32.812631 1 trace.go:236] Trace[1526659359]: "Get" accept:application/json, */*,audit-id:bc839b3d-b209-4844-bc01-5eebbd9242a3,client:10.0.0.7,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 19:53:28.675) (total time: 4137ms): Trace[1526659359]: ---"About to write a response" 4137ms (19:53:32.812) Trace[1526659359]: [4.137239318s] [4.137239318s] END I0628 19:53:32.812671 1 trace.go:236] Trace[903460903]: "Get" accept:application/json, */*,audit-id:0679bb9e-0bea-4d8d-996e-900ec7d288ed,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 19:53:31.945) (total time: 867ms): Trace[903460903]: ---"About to write a response" 867ms (19:53:32.812) Trace[903460903]: [867.457075ms] [867.457075ms] END I0628 19:53:32.812817 1 trace.go:236] Trace[558855755]: "Get" accept:application/json, */*,audit-id:4b979b85-8e2c-4d69-a66f-251dfd9d4484,client:10.0.0.25,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-37a27867-ceeb-4cbe-a0dc-96bde9391ce2,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:53:28.242) (total time: 4570ms): Trace[558855755]: ---"About to write a response" 4569ms (19:53:32.812) Trace[558855755]: [4.57015397s] [4.57015397s] END I0628 19:53:32.814337 1 trace.go:236] Trace[481596011]: "Get" accept:application/json, */*,audit-id:c3e7ce3d-5df4-4a87-918c-cb3a1101c6d7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:53:27.909) (total time: 4904ms): Trace[481596011]: ---"About to write a response" 4901ms (19:53:32.811) Trace[481596011]: [4.904690148s] [4.904690148s] END I0628 19:53:32.814525 1 trace.go:236] Trace[620858403]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c708395d-8d72-4d60-8d9d-6f0c650361f6,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (28-Jun-2026 19:53:31.821) (total time: 992ms): Trace[620858403]: ["GuaranteedUpdate etcd3" audit-id:c708395d-8d72-4d60-8d9d-6f0c650361f6,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 992ms (19:53:31.822) Trace[620858403]: ---"Txn call completed" 987ms (19:53:32.810)] Trace[620858403]: [992.540425ms] [992.540425ms] END I0628 19:53:32.814641 1 trace.go:236] Trace[231859344]: "Get" accept:application/json,audit-id:257389f9-9142-473e-820a-ca4c5d61ca21,client:199.204.45.77,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (28-Jun-2026 19:53:28.406) (total time: 4407ms): Trace[231859344]: ---"About to write a response" 4405ms (19:53:32.812) Trace[231859344]: [4.407646777s] [4.407646777s] END I0628 19:53:32.827486 1 trace.go:236] Trace[358602913]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.77,type:*v1.Endpoints,resource:apiServerIPInfo (28-Jun-2026 19:53:28.979) (total time: 3847ms): Trace[358602913]: ---"initial value restored" 3832ms (19:53:32.812) Trace[358602913]: [3.847777919s] [3.847777919s] END I0628 19:53:50.052370 1 trace.go:236] Trace[1451271763]: "Get" accept:application/json, */*,audit-id:7b862a3a-d6f9-44f7-bfa9-6c3924b6bcf9,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 19:53:49.451) (total time: 600ms): Trace[1451271763]: ---"About to write a response" 600ms (19:53:50.052) Trace[1451271763]: [600.99175ms] [600.99175ms] END I0628 19:54:12.818689 1 trace.go:236] Trace[900951847]: "Update" accept:application/json, */*,audit-id:794283f8-eedc-4fc2-be7b-1fe5d0f11bfb,client:10.0.0.7,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:54:12.247) (total time: 571ms): Trace[900951847]: ["GuaranteedUpdate etcd3" audit-id:794283f8-eedc-4fc2-be7b-1fe5d0f11bfb,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 571ms (19:54:12.247) Trace[900951847]: ---"Txn call completed" 570ms (19:54:12.818)] Trace[900951847]: [571.579339ms] [571.579339ms] END I0628 19:54:12.819340 1 trace.go:236] Trace[231045164]: "Update" accept:application/json, */*,audit-id:c4311824-5f8b-46e8-bb2a-48569a3e0bbd,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:54:12.244) (total time: 574ms): Trace[231045164]: ["GuaranteedUpdate etcd3" audit-id:c4311824-5f8b-46e8-bb2a-48569a3e0bbd,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 574ms (19:54:12.244) Trace[231045164]: ---"Txn call completed" 573ms (19:54:12.819)] Trace[231045164]: [574.559569ms] [574.559569ms] END I0628 19:54:12.819678 1 trace.go:236] Trace[977121349]: "Update" accept:application/json, */*,audit-id:c3e303d7-d6da-4a35-8de2-f2b8cbebf767,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Jun-2026 19:54:12.245) (total time: 574ms): Trace[977121349]: ["GuaranteedUpdate etcd3" audit-id:c3e303d7-d6da-4a35-8de2-f2b8cbebf767,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 573ms (19:54:12.245) Trace[977121349]: ---"Txn call completed" 572ms (19:54:12.819)] Trace[977121349]: [574.041873ms] [574.041873ms] END I0628 19:54:15.557807 1 trace.go:236] Trace[1702739726]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8581245b-f150-4a2a-83f8-e7f97acb52fe,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:54:14.863) (total time: 694ms): Trace[1702739726]: ---"About to write a response" 694ms (19:54:15.557) Trace[1702739726]: [694.675523ms] [694.675523ms] END I0628 19:54:15.557957 1 trace.go:236] Trace[1705523911]: "Get" accept:application/json, */*,audit-id:d11ef1e1-a3b8-40c0-977a-8e6f5d1c0896,client:10.0.0.7,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 19:54:14.822) (total time: 735ms): Trace[1705523911]: ---"About to write a response" 735ms (19:54:15.557) Trace[1705523911]: [735.794791ms] [735.794791ms] END I0628 19:54:15.559162 1 trace.go:236] Trace[597571476]: "Get" accept:application/json, */*,audit-id:7ad17083-aa69-495b-b337-0c963b29fa6c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:54:14.823) (total time: 736ms): Trace[597571476]: ---"About to write a response" 735ms (19:54:15.558) Trace[597571476]: [736.021384ms] [736.021384ms] END I0628 19:54:15.559772 1 trace.go:236] Trace[143748058]: "Get" accept:application/json, */*,audit-id:43ba8f7d-184f-45ac-a38e-e512a1c0cd09,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 19:54:14.822) (total time: 737ms): Trace[143748058]: ---"About to write a response" 737ms (19:54:15.559) Trace[143748058]: [737.531624ms] [737.531624ms] END I0628 19:54:15.561071 1 trace.go:236] Trace[1473132019]: "Get" accept:application/json,audit-id:85d1d892-62b5-476c-ab9f-9a0a542d95e4,client:199.204.45.77,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (28-Jun-2026 19:54:14.978) (total time: 582ms): Trace[1473132019]: ---"About to write a response" 581ms (19:54:15.560) Trace[1473132019]: [582.03157ms] [582.03157ms] END I0628 19:54:16.051456 1 trace.go:236] Trace[1677437528]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b837fb20-060a-4540-8190-6ac5a51b3c62,client:10.0.0.143,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:54:15.542) (total time: 509ms): Trace[1677437528]: ["GuaranteedUpdate etcd3" audit-id:b837fb20-060a-4540-8190-6ac5a51b3c62,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 509ms (19:54:15.542) Trace[1677437528]: ---"Txn call completed" 508ms (19:54:16.051)] Trace[1677437528]: [509.273899ms] [509.273899ms] END I0628 19:54:16.051580 1 trace.go:236] Trace[672729276]: "Update" accept:application/json, */*,audit-id:fc7138a9-c984-4099-b78c-10ac41792f63,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:54:15.383) (total time: 667ms): Trace[672729276]: ["GuaranteedUpdate etcd3" audit-id:fc7138a9-c984-4099-b78c-10ac41792f63,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 667ms (19:54:15.384) Trace[672729276]: ---"Txn call completed" 666ms (19:54:16.051)] Trace[672729276]: [667.706866ms] [667.706866ms] END I0628 19:54:16.059587 1 trace.go:236] Trace[636625488]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b158c806-107e-4ca5-8548-0b45b7cbd832,client:199.204.45.77,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18bd56c6fc9cf873,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:54:15.338) (total time: 720ms): Trace[636625488]: ["GuaranteedUpdate etcd3" audit-id:b158c806-107e-4ca5-8548-0b45b7cbd832,key:/events/openstack/percona-xtradb-haproxy-0.18bd56c6fc9cf873,type:*core.Event,resource:events 720ms (19:54:15.339) Trace[636625488]: ---"initial value restored" 264ms (19:54:15.603) Trace[636625488]: ---"Txn call completed" 453ms (19:54:16.059)] Trace[636625488]: ---"Object stored in database" 454ms (19:54:16.059) Trace[636625488]: [720.641349ms] [720.641349ms] END I0628 19:54:47.594642 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.108.171.255"} I0628 19:54:49.493477 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.98.190.28"} I0628 19:54:50.275406 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.96.18.248"} I0628 19:54:58.073127 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.109.71.92"} I0628 19:54:58.082477 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.110.7.228"} I0628 19:57:17.890341 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0628 19:57:19.733530 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0628 19:57:19.739011 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0628 19:57:19.754007 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0628 19:57:19.768730 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 19:57:19.780192 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 19:57:19.794145 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 19:57:19.805796 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 19:57:31.486082 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0628 19:58:10.049078 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0628 19:58:24.065671 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0628 19:58:24.303897 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:58:24.331791 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:58:24.411610 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:58:24.667063 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0628 19:58:24.989106 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:58:25.019203 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:58:25.116500 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0628 19:58:25.344103 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:58:25.606201 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 19:59:07.837449 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.108.228.79"} I0628 19:59:07.851756 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.110.138.133"} I0628 19:59:07.864854 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.104.242.85"} I0628 19:59:07.876855 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.101.10.100"} I0628 19:59:07.885082 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.98.6.52"} I0628 19:59:07.897516 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.101.80.67"} I0628 19:59:07.940012 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0628 19:59:07.960387 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0628 19:59:08.018666 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0628 19:59:08.043114 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0628 19:59:08.075507 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0628 19:59:09.090925 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.090980 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.090991 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.091045 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.091002 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.091097 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.091120 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.091215 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094792 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094818 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.094832 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.094837 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094834 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.094861 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094834 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094869 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.094922 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094885 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094944 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.094953 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.094976 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.094999 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.095062 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.095077 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.095079 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.095003 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.095096 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.095087 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused W0628 19:59:09.095130 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.095212 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused I0628 19:59:09.097900 1 trace.go:236] Trace[49206136]: "Create" accept:application/json,audit-id:159f8bad-5eaa-4739-9138-eea02dc26b2a,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1013ms): Trace[49206136]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:f389e2ff-eb43-452a-8d45-8e36e237cf2c 1012ms (19:59:08.085)] Trace[49206136]: [1.013655044s] [1.013655044s] END I0628 19:59:09.099890 1 trace.go:236] Trace[1842629952]: "Create" accept:application/json,audit-id:18cd6772-e0ca-42bd-a11e-ed601adec142,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.082) (total time: 1017ms): Trace[1842629952]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:30cdedf5-4404-44fe-87e4-e9607ad7aa46 1015ms (19:59:08.083)] Trace[1842629952]: [1.017411768s] [1.017411768s] END I0628 19:59:09.100057 1 trace.go:236] Trace[1149795830]: "Create" accept:application/json,audit-id:d4c0628d-9e55-421d-939b-c5dedcf1aab0,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1015ms): Trace[1149795830]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:c96d4fe4-331a-4120-bdf2-83efa0235f88 1014ms (19:59:08.085)] Trace[1149795830]: [1.015125737s] [1.015125737s] END I0628 19:59:09.100474 1 trace.go:236] Trace[1125879393]: "Create" accept:application/json,audit-id:21489258-b22b-498d-a477-f15c52341571,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1015ms): Trace[1125879393]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:dd1b1435-b7d8-4e7d-b71f-11b7a6d54218 1012ms (19:59:08.087)] Trace[1125879393]: [1.015575387s] [1.015575387s] END I0628 19:59:09.103206 1 trace.go:236] Trace[1661224508]: "Create" accept:application/json,audit-id:f86f82eb-f7b8-4951-992e-6316ba7077b8,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.083) (total time: 1019ms): Trace[1661224508]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:4dd5d85a-3c53-421f-b6e9-6bab1adc0278 1018ms (19:59:08.084)] Trace[1661224508]: [1.019995186s] [1.019995186s] END I0628 19:59:09.103655 1 trace.go:236] Trace[1349924205]: "Create" accept:application/json,audit-id:7d40ca2a-30e7-486c-a312-9077c061f311,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.082) (total time: 1020ms): Trace[1349924205]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:fb2380e2-0f71-4cc0-9d6e-02bc280293b8 1014ms (19:59:08.089)] Trace[1349924205]: [1.020861875s] [1.020861875s] END I0628 19:59:09.103833 1 trace.go:236] Trace[55557645]: "Create" accept:application/json,audit-id:a24fbd98-e949-48c5-b62a-b34df1fa1bd3,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.082) (total time: 1020ms): Trace[55557645]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:27e32915-227d-404a-bc75-09c6c363a5fa 1020ms (19:59:08.083)] Trace[55557645]: [1.020828494s] [1.020828494s] END I0628 19:59:09.104668 1 trace.go:236] Trace[1191573647]: "Create" accept:application/json,audit-id:95786b19-6f50-42fe-a760-684163465df0,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1019ms): Trace[1191573647]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:0de5791b-beec-4f0a-b13f-bdd3920f7f85 1019ms (19:59:08.085)] Trace[1191573647]: [1.019666638s] [1.019666638s] END I0628 19:59:09.105496 1 trace.go:236] Trace[401903908]: "Create" accept:application/json,audit-id:0b763e06-c3a3-400d-8da1-14a2c2b1a879,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.083) (total time: 1021ms): Trace[401903908]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:b50304e7-e0a9-45bd-a85f-5407bcf4153f 1020ms (19:59:08.085)] Trace[401903908]: [1.021497149s] [1.021497149s] END I0628 19:59:09.105583 1 trace.go:236] Trace[1123860085]: "Create" accept:application/json,audit-id:268add51-6942-4b33-85e1-8674049398b7,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1020ms): Trace[1123860085]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:d373add5-ced7-4cfc-9a55-2521a5e8fdb9 1017ms (19:59:08.087)] Trace[1123860085]: [1.020725402s] [1.020725402s] END I0628 19:59:09.105690 1 trace.go:236] Trace[307694712]: "Create" accept:application/json,audit-id:0ee5159d-1b76-49f7-82f6-7587d718c0d2,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.082) (total time: 1022ms): Trace[307694712]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:efeb2652-d87f-45ca-80db-0b6eb506a7d9 1021ms (19:59:08.083)] Trace[307694712]: [1.022994973s] [1.022994973s] END I0628 19:59:09.106374 1 trace.go:236] Trace[629324021]: "Create" accept:application/json,audit-id:cd2032c7-4d8c-4acd-b788-61180b4621a7,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1021ms): Trace[629324021]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:4e5233d4-29e1-408f-aad3-1dc4782d8d4c 1018ms (19:59:08.087)] Trace[629324021]: [1.021710164s] [1.021710164s] END I0628 19:59:09.106695 1 trace.go:236] Trace[1237862910]: "Create" accept:application/json,audit-id:c0ed1188-0546-48f8-b79d-f81ae6a71e9d,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.083) (total time: 1023ms): Trace[1237862910]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:3d83ed90-b6bb-47bf-bae3-71c573a4e079 1019ms (19:59:08.086)] Trace[1237862910]: [1.023484794s] [1.023484794s] END I0628 19:59:09.106715 1 trace.go:236] Trace[1520340322]: "Create" accept:application/json,audit-id:4c330a6f-b20c-4722-8627-c03c853793a2,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1022ms): Trace[1520340322]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:6b7facaa-c47d-41e7-80b3-12b8cea1af16 1017ms (19:59:08.089)] Trace[1520340322]: [1.022088883s] [1.022088883s] END I0628 19:59:09.106817 1 trace.go:236] Trace[1882351373]: "Create" accept:application/json,audit-id:daab38d5-4f9c-4998-9238-a7a1d8826b7c,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.085) (total time: 1021ms): Trace[1882351373]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:097868b5-11ae-456f-a864-43144700f34f 1020ms (19:59:08.086)] Trace[1882351373]: [1.021669383s] [1.021669383s] END W0628 19:59:09.122770 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused E0628 19:59:09.122807 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.80.67:443: connect: connection refused I0628 19:59:09.127878 1 trace.go:236] Trace[1481398374]: "Create" accept:application/json,audit-id:842968df-3b90-4278-8ce9-835e58d5b24b,client:199.204.45.77,protocol:HTTP/2.0,resource:prometheusrules,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheusrules,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 19:59:08.084) (total time: 1043ms): Trace[1481398374]: ["Call mutating webhook" configuration:kube-prometheus-stack-admission,webhook:prometheusrulemutate.monitoring.coreos.com,resource:monitoring.coreos.com/v1, Resource=prometheusrules,subresource:,operation:CREATE,UID:6821c487-17d2-449d-95a2-924ecfdae194 1037ms (19:59:08.090)] Trace[1481398374]: [1.043603455s] [1.043603455s] END I0628 19:59:24.547043 1 trace.go:236] Trace[214091768]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aad8f9b8-6d6c-4c5b-8487-da217c13413f,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/alertmanager-kube-prometheus-stack-alertmanager-0/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:59:23.931) (total time: 615ms): Trace[214091768]: ["GuaranteedUpdate etcd3" audit-id:aad8f9b8-6d6c-4c5b-8487-da217c13413f,key:/pods/monitoring/alertmanager-kube-prometheus-stack-alertmanager-0,type:*core.Pod,resource:pods 615ms (19:59:23.931) Trace[214091768]: ---"Txn call completed" 606ms (19:59:24.546)] Trace[214091768]: ---"Object stored in database" 607ms (19:59:24.546) Trace[214091768]: [615.740265ms] [615.740265ms] END I0628 19:59:24.565084 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0628 19:59:24.716273 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.97.72.1"} I0628 20:00:05.018465 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.96.135.85"} I0628 20:00:05.030333 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0628 20:00:22.987601 1 trace.go:236] Trace[1569085929]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4d74a23d-351c-41a9-a59e-9f0ddcc0352b,client:199.204.45.77,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keystone-credential-setup-4mbzq/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 20:00:22.224) (total time: 763ms): Trace[1569085929]: ["GuaranteedUpdate etcd3" audit-id:4d74a23d-351c-41a9-a59e-9f0ddcc0352b,key:/pods/openstack/keystone-credential-setup-4mbzq,type:*core.Pod,resource:pods 763ms (20:00:22.224) Trace[1569085929]: ---"Txn call completed" 756ms (20:00:22.986)] Trace[1569085929]: ---"Object stored in database" 757ms (20:00:22.987) Trace[1569085929]: [763.270529ms] [763.270529ms] END I0628 20:00:23.311627 1 trace.go:236] Trace[1744488426]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a4c60afd-5e82-4ab5-bd3b-5b491c34576c,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (28-Jun-2026 20:00:22.463) (total time: 847ms): Trace[1744488426]: ["GuaranteedUpdate etcd3" audit-id:a4c60afd-5e82-4ab5-bd3b-5b491c34576c,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 847ms (20:00:22.463) Trace[1744488426]: ---"Txn call completed" 846ms (20:00:23.311)] Trace[1744488426]: [847.870784ms] [847.870784ms] END I0628 20:00:23.311668 1 trace.go:236] Trace[1020514284]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b3ba2685-8854-4d62-b035-3a2e104bd607,client:10.0.0.160,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:00:22.284) (total time: 1027ms): Trace[1020514284]: ["GuaranteedUpdate etcd3" audit-id:b3ba2685-8854-4d62-b035-3a2e104bd607,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1026ms (20:00:22.284) Trace[1020514284]: ---"Txn call completed" 1026ms (20:00:23.311)] Trace[1020514284]: [1.027059559s] [1.027059559s] END I0628 20:00:23.312147 1 trace.go:236] Trace[1025760372]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:40dcaac4-bcf4-42dc-81b2-282cbdaba266,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (28-Jun-2026 20:00:22.564) (total time: 748ms): Trace[1025760372]: ["GuaranteedUpdate etcd3" audit-id:40dcaac4-bcf4-42dc-81b2-282cbdaba266,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 747ms (20:00:22.564) Trace[1025760372]: ---"Txn call completed" 746ms (20:00:23.311)] Trace[1025760372]: [748.085632ms] [748.085632ms] END I0628 20:00:23.328698 1 trace.go:236] Trace[547940211]: "Get" accept:application/json, */*,audit-id:df053d5d-a861-462f-8041-c1e1b16b1dbc,client:10.0.0.215,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:00:22.479) (total time: 849ms): Trace[547940211]: [849.050906ms] [849.050906ms] END I0628 20:00:23.329053 1 trace.go:236] Trace[667259358]: "Get" accept:application/json, */*,audit-id:a66ea51e-9cad-4e35-a80c-159f88435449,client:10.0.0.215,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-fernet-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:00:22.481) (total time: 848ms): Trace[667259358]: [848.010046ms] [848.010046ms] END I0628 20:00:23.329936 1 trace.go:236] Trace[1834858601]: "Get" accept:application/json, */*,audit-id:bdb3e68b-1343-4093-9256-11adf8a1aada,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:00:22.524) (total time: 805ms): Trace[1834858601]: ---"About to write a response" 805ms (20:00:23.329) Trace[1834858601]: [805.73511ms] [805.73511ms] END I0628 20:00:23.330126 1 trace.go:236] Trace[1041722536]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a387cbd2-8087-4779-b101-650486a93667,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:00:22.511) (total time: 818ms): Trace[1041722536]: ---"About to write a response" 818ms (20:00:23.330) Trace[1041722536]: [818.193737ms] [818.193737ms] END I0628 20:00:23.331120 1 trace.go:236] Trace[603398354]: "Get" accept:application/json, */*,audit-id:d3d708a3-bc6d-4122-a347-84d5ef090aa9,client:10.0.0.215,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/keystone-credential-setup,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:00:22.481) (total time: 849ms): Trace[603398354]: ---"About to write a response" 849ms (20:00:23.330) Trace[603398354]: [849.880021ms] [849.880021ms] END I0628 20:00:23.331635 1 trace.go:236] Trace[1186446011]: "Get" accept:application/json, */*,audit-id:b20b213d-11e9-496b-9f09-1eada10c0e73,client:10.0.0.7,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 20:00:22.574) (total time: 756ms): Trace[1186446011]: ---"About to write a response" 756ms (20:00:23.331) Trace[1186446011]: [756.873869ms] [756.873869ms] END I0628 20:00:23.333688 1 trace.go:236] Trace[929296460]: "Get" accept:application/json, */*,audit-id:aa1b8ea9-892d-4619-ae02-44a993ca6160,client:199.204.45.77,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 20:00:22.523) (total time: 809ms): Trace[929296460]: ---"About to write a response" 805ms (20:00:23.329) Trace[929296460]: [809.95293ms] [809.95293ms] END E0628 20:02:50.280390 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc02c101f50), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc02bdb8d20), ResponseWriter:(*httpsnoop.rw)(0xc02bdb8d20), Flusher:(*httpsnoop.rw)(0xc02bdb8d20), CloseNotifier:(*httpsnoop.rw)(0xc02bdb8d20), Pusher:(*httpsnoop.rw)(0xc02bdb8d20)}}, encoder:(*versioning.codec)(0xc037428280), memAllocator:(*runtime.Allocator)(0xc0077d6558)}) I0628 20:03:03.858272 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.100.184.144"} I0628 20:03:03.919324 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.97.158.196"}