I0628 19:55:55.129223 1 options.go:220] external host was not specified, using 199.204.45.210 I0628 19:55:55.131452 1 server.go:148] Version: v1.28.13 I0628 19:55:55.131509 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0628 19:55:55.598629 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0628 19:55:55.608200 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0628 19:55:55.608258 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0628 19:55:55.608511 1 instance.go:298] Using reconciler: lease I0628 19:55:55.663561 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0628 19:55:55.663596 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0628 19:55:55.926851 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0628 19:55:55.927139 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0628 19:55:56.389217 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0628 19:55:56.402739 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0628 19:55:56.402792 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.402804 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.403514 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0628 19:55:56.403531 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0628 19:55:56.404612 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0628 19:55:56.405744 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0628 19:55:56.405759 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0628 19:55:56.405764 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0628 19:55:56.407470 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0628 19:55:56.407489 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0628 19:55:56.408522 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0628 19:55:56.408542 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.408547 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.409257 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0628 19:55:56.409276 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.409328 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0628 19:55:56.410051 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0628 19:55:56.412177 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0628 19:55:56.412196 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.412201 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.412744 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0628 19:55:56.412760 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.412765 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.413631 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0628 19:55:56.413651 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0628 19:55:56.415510 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0628 19:55:56.415528 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.415532 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.415989 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0628 19:55:56.416006 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.416010 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.418392 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0628 19:55:56.418410 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.418413 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.419481 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0628 19:55:56.420821 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0628 19:55:56.420840 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.420844 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.424647 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0628 19:55:56.424667 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0628 19:55:56.424671 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0628 19:55:56.425524 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0628 19:55:56.425539 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0628 19:55:56.425542 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0628 19:55:56.426036 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0628 19:55:56.426069 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0628 19:55:56.462392 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0628 19:55:56.462431 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0628 19:55:56.893964 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0628 19:55:56.893987 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0628 19:55:56.894041 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0628 19:55:56.894280 1 secure_serving.go:213] Serving securely on [::]:6443 I0628 19:55:56.894474 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0628 19:55:56.894522 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0628 19:55:56.894554 1 controller.go:80] Starting OpenAPI V3 AggregationController I0628 19:55:56.894619 1 system_namespaces_controller.go:67] Starting system namespaces controller I0628 19:55:56.894715 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0628 19:55:56.894813 1 aggregator.go:164] waiting for initial CRD sync... I0628 19:55:56.894839 1 gc_controller.go:78] Starting apiserver lease garbage collector I0628 19:55:56.894863 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0628 19:55:56.894536 1 controller.go:78] Starting OpenAPI AggregationController I0628 19:55:56.894914 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0628 19:55:56.894825 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0628 19:55:56.894884 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0628 19:55:56.895052 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0628 19:55:56.895069 1 controller.go:116] Starting legacy_token_tracking_controller I0628 19:55:56.895088 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0628 19:55:56.894974 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0628 19:55:56.895167 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0628 19:55:56.895162 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0628 19:55:56.895002 1 gc_controller.go:78] Starting apiserver lease garbage collector I0628 19:55:56.895329 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0628 19:55:56.895343 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0628 19:55:56.895451 1 controller.go:85] Starting OpenAPI V3 controller I0628 19:55:56.895500 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0628 19:55:56.895504 1 naming_controller.go:291] Starting NamingConditionController I0628 19:55:56.895553 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0628 19:55:56.895580 1 crd_finalizer.go:266] Starting CRDFinalizer I0628 19:55:56.895638 1 establishing_controller.go:76] Starting EstablishingController I0628 19:55:56.895415 1 controller.go:134] Starting OpenAPI controller I0628 19:55:56.896018 1 available_controller.go:423] Starting AvailableConditionController I0628 19:55:56.896046 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller E0628 19:55:56.967873 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0628 19:55:56.995672 1 apf_controller.go:379] Running API Priority and Fairness config worker I0628 19:55:56.995700 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0628 19:55:56.995713 1 shared_informer.go:318] Caches are synced for configmaps I0628 19:55:56.995947 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0628 19:55:56.996214 1 cache.go:39] Caches are synced for AvailableConditionController controller I0628 19:55:56.996260 1 shared_informer.go:318] Caches are synced for crd-autoregister I0628 19:55:56.996294 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0628 19:55:56.996462 1 aggregator.go:166] initial CRD sync complete... I0628 19:55:56.996498 1 autoregister_controller.go:141] Starting autoregister controller I0628 19:55:56.996512 1 cache.go:32] Waiting for caches to sync for autoregister controller I0628 19:55:56.996606 1 cache.go:39] Caches are synced for autoregister controller I0628 19:55:56.998581 1 controller.go:624] quota admission added evaluator for: namespaces I0628 19:55:56.998824 1 shared_informer.go:318] Caches are synced for node_authorizer I0628 19:55:57.174263 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0628 19:55:57.902948 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0628 19:55:57.910015 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0628 19:55:57.910040 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0628 19:55:58.680746 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0628 19:55:58.740942 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0628 19:55:58.810185 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0628 19:55:58.819618 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.210] I0628 19:55:58.820772 1 controller.go:624] quota admission added evaluator for: endpoints I0628 19:55:58.825821 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0628 19:56:00.460739 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0628 19:56:00.471471 1 controller.go:624] quota admission added evaluator for: deployments.apps I0628 19:56:00.502095 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0628 19:56:00.893750 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0628 19:56:05.987288 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0628 19:56:06.188888 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0628 19:56:13.240854 1 trace.go:236] Trace[323417264]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4edb6e1d-19a3-4104-bdc9-cf16177ed3e9,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/etcd-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:56:12.273) (total time: 966ms): Trace[323417264]: ["GuaranteedUpdate etcd3" audit-id:4edb6e1d-19a3-4104-bdc9-cf16177ed3e9,key:/pods/kube-system/etcd-instance,type:*core.Pod,resource:pods 967ms (19:56:12.273) Trace[323417264]: ---"Txn call completed" 960ms (19:56:13.238)] Trace[323417264]: ---"Object stored in database" 961ms (19:56:13.238) Trace[323417264]: [966.515319ms] [966.515319ms] END I0628 19:56:24.554298 1 trace.go:236] Trace[770323555]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:edb6c503-edb1-49f5-9163-a9f943cd56a0,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Jun-2026 19:56:23.950) (total time: 604ms): Trace[770323555]: ["GuaranteedUpdate etcd3" audit-id:edb6c503-edb1-49f5-9163-a9f943cd56a0,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 604ms (19:56:23.950) Trace[770323555]: ---"Txn call completed" 603ms (19:56:24.554)] Trace[770323555]: [604.162833ms] [604.162833ms] END I0628 19:56:37.864865 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:56:37.875066 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0628 19:56:37.885772 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0628 19:56:37.935371 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:56:37.935410 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0628 19:56:37.944581 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0628 19:56:37.961559 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0628 19:56:37.971235 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0628 19:56:37.998127 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0628 19:56:37.998186 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0628 19:56:38.058060 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:56:38.058187 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:56:38.098727 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:56:38.243623 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:56:38.243723 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:56:38.253310 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0628 19:56:38.253408 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0628 19:56:38.280806 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:38.332357 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:38.343417 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:38.384196 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:38.403097 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:39.053072 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:39.171542 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0628 19:56:46.765633 1 trace.go:236] Trace[1568215212]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d35bd772-85be-4b17-b0cd-834921759d5b,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:56:45.984) (total time: 781ms): Trace[1568215212]: ---"About to write a response" 781ms (19:56:46.765) Trace[1568215212]: [781.195054ms] [781.195054ms] END I0628 19:56:46.765753 1 trace.go:236] Trace[424899048]: "Get" accept:application/json, */*,audit-id:f6a04651-0bb9-4d2a-84df-a9f7adbee0f7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:56:46.172) (total time: 593ms): Trace[424899048]: ---"About to write a response" 593ms (19:56:46.765) Trace[424899048]: [593.310003ms] [593.310003ms] END I0628 19:56:46.802192 1 trace.go:236] Trace[95686012]: "Update" accept:application/json, */*,audit-id:9ddfae40-9b97-4e21-8993-2d81301225a2,client:199.204.45.210,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (28-Jun-2026 19:56:45.514) (total time: 1287ms): Trace[95686012]: ---"Conversion done" 19ms (19:56:45.538) Trace[95686012]: ["GuaranteedUpdate etcd3" audit-id:9ddfae40-9b97-4e21-8993-2d81301225a2,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 1263ms (19:56:45.539) Trace[95686012]: ---"Txn call completed" 1219ms (19:56:46.765)] Trace[95686012]: ---"Writing http response done" 35ms (19:56:46.802) Trace[95686012]: [1.287431977s] [1.287431977s] END I0628 19:56:46.829967 1 controller.go:624] quota admission added evaluator for: jobs.batch I0628 19:56:48.243658 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:56:48.253790 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:56:48.262077 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:56:48.271825 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:56:48.279623 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:56:48.821636 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:56:49.024898 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0628 19:56:50.322074 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:56:50.442315 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:56:51.224503 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0628 19:56:51.611849 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0628 19:56:58.363511 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0628 19:56:58.363575 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0628 19:56:58.972528 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0628 19:57:07.518940 1 trace.go:236] Trace[1961724379]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bae94392-dc63-492b-ade4-7dfa6254d804,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-gateway-helm-certgen-n579w/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:57:06.824) (total time: 693ms): Trace[1961724379]: ["GuaranteedUpdate etcd3" audit-id:bae94392-dc63-492b-ade4-7dfa6254d804,key:/pods/envoy-gateway-system/envoy-gateway-gateway-helm-certgen-n579w,type:*core.Pod,resource:pods 693ms (19:57:06.824) Trace[1961724379]: ---"Txn call completed" 689ms (19:57:07.517)] Trace[1961724379]: ---"Object stored in database" 690ms (19:57:07.518) Trace[1961724379]: [693.511777ms] [693.511777ms] END I0628 19:57:07.519005 1 trace.go:236] Trace[1689956477]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Jun-2026 19:57:06.862) (total time: 656ms): Trace[1689956477]: [656.533447ms] [656.533447ms] END I0628 19:57:07.519063 1 trace.go:236] Trace[267334812]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:fe0204b5-7f73-4fbc-9b31-ce645ffcf9b3,client:199.204.45.210,protocol:HTTP/2.0,resource:gatewayclasses,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/gatewayclasses,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Jun-2026 19:57:06.878) (total time: 640ms): Trace[267334812]: ["List(recursive=true) etcd3" audit-id:fe0204b5-7f73-4fbc-9b31-ce645ffcf9b3,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 640ms (19:57:06.878)] Trace[267334812]: [640.211016ms] [640.211016ms] END I0628 19:57:07.519264 1 trace.go:236] Trace[1003830510]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Jun-2026 19:57:06.878) (total time: 640ms): Trace[1003830510]: [640.939977ms] [640.939977ms] END I0628 19:57:07.519263 1 trace.go:236] Trace[1095001179]: "List(recursive=true) etcd3" audit-id:,key:/cilium.io/ciliumexternalworkloads,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Jun-2026 19:57:06.840) (total time: 678ms): Trace[1095001179]: [678.78347ms] [678.78347ms] END I0628 19:57:07.519672 1 trace.go:236] Trace[11020199]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:9d875754-c7f8-4d7c-8e7d-56e2d8f623e8,client:199.204.45.210,protocol:HTTP/2.0,resource:ciliuml2announcementpolicies,scope:cluster,url:/apis/cilium.io/v2alpha1/ciliuml2announcementpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Jun-2026 19:57:06.894) (total time: 624ms): Trace[11020199]: ["List(recursive=true) etcd3" audit-id:9d875754-c7f8-4d7c-8e7d-56e2d8f623e8,key:/cilium.io/ciliuml2announcementpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 624ms (19:57:06.895)] Trace[11020199]: [624.650617ms] [624.650617ms] END I0628 19:57:07.519862 1 trace.go:236] Trace[734956013]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:80063e11-f50e-4dce-87c6-93c18215c869,client:199.204.45.210,protocol:HTTP/2.0,resource:ciliumexternalworkloads,scope:cluster,url:/apis/cilium.io/v2/ciliumexternalworkloads,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Jun-2026 19:57:06.841) (total time: 678ms): Trace[734956013]: ["List(recursive=true) etcd3" audit-id:80063e11-f50e-4dce-87c6-93c18215c869,key:/cilium.io/ciliumexternalworkloads,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 678ms (19:57:06.841)] Trace[734956013]: [678.309668ms] [678.309668ms] END I0628 19:57:07.519965 1 trace.go:236] Trace[1094470960]: "List(recursive=true) etcd3" audit-id:,key:/cilium.io/ciliuml2announcementpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Jun-2026 19:57:06.894) (total time: 625ms): Trace[1094470960]: [625.714316ms] [625.714316ms] END I0628 19:57:10.928044 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.103.65.8"} W0628 19:57:10.961608 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.65.8:9443: connect: connection refused E0628 19:57:10.961664 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.65.8:9443: connect: connection refused I0628 19:57:23.710242 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0628 19:57:23.722284 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:57:23.737767 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:57:23.757314 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.100.62.191"} I0628 19:57:23.764902 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.108.22.97"} I0628 19:57:23.789386 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0628 19:57:23.890599 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0628 19:57:23.924833 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0628 19:57:33.940948 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.108.22.97:443: connect: connection refused W0628 19:57:38.924525 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.108.22.97:443: connect: connection refused I0628 19:57:43.939139 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0628 19:57:44.937420 1 trace.go:236] Trace[1794242124]: "Update" accept:application/json, */*,audit-id:d75a42f8-1136-4079-a2a1-df9203515f44,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Jun-2026 19:57:44.060) (total time: 876ms): Trace[1794242124]: ["GuaranteedUpdate etcd3" audit-id:d75a42f8-1136-4079-a2a1-df9203515f44,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 876ms (19:57:44.061) Trace[1794242124]: ---"Txn call completed" 874ms (19:57:44.937)] Trace[1794242124]: [876.437857ms] [876.437857ms] END I0628 19:57:44.961668 1 trace.go:236] Trace[1125255515]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4816499a-7c70-41b2-a24e-2aedb58dd9b8,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:57:44.308) (total time: 653ms): Trace[1125255515]: ["GuaranteedUpdate etcd3" audit-id:4816499a-7c70-41b2-a24e-2aedb58dd9b8,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 653ms (19:57:44.308) Trace[1125255515]: ---"Txn call completed" 652ms (19:57:44.961)] Trace[1125255515]: [653.31331ms] [653.31331ms] END I0628 19:57:44.962687 1 trace.go:236] Trace[6198932]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fc9d0caa-91bd-4aa4-b1e9-9c567c34b6bf,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:57:44.398) (total time: 564ms): Trace[6198932]: ---"About to write a response" 564ms (19:57:44.962) Trace[6198932]: [564.630559ms] [564.630559ms] END I0628 19:57:50.304253 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0628 19:58:04.306342 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.107.53.219"} I0628 19:58:04.340510 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.109.36.89"} I0628 19:58:04.350221 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.98.208.246"} I0628 19:58:04.357484 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.101.190.218"} I0628 19:58:10.920977 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:10.942663 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:10.968970 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:10.991913 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.009358 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.035414 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.053362 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.089565 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.174443 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.196974 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0628 19:58:11.229536 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.260739 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:11.303295 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:12.673021 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0628 19:58:16.556868 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0628 19:58:16.562625 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0628 19:58:16.621877 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.104.159.117"} I0628 19:58:16.653391 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0628 19:58:19.668230 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0628 19:58:19.864677 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0628 19:58:20.833548 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0628 19:58:20.833585 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0628 19:58:20.833614 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0628 19:58:27.934646 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0628 19:58:31.339186 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.109.208.232"} I0628 19:58:31.616954 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0628 19:58:31.769811 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.109.89.200"} I0628 19:58:31.780758 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.101.212.156"} I0628 19:58:35.210080 1 trace.go:236] Trace[128935095]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:289abdb3-bbc4-43b5-ae38-6b6aeb25cbd3,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:58:34.288) (total time: 921ms): Trace[128935095]: ["GuaranteedUpdate etcd3" audit-id:289abdb3-bbc4-43b5-ae38-6b6aeb25cbd3,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 921ms (19:58:34.288) Trace[128935095]: ---"Txn call completed" 920ms (19:58:35.209)] Trace[128935095]: [921.871962ms] [921.871962ms] END I0628 19:58:35.437527 1 trace.go:236] Trace[300223409]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:23a04092-d50c-478f-a408-f0398194139d,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-8d58cdbf-a0e5-482b-a39a-25df134ed133,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Jun-2026 19:58:34.325) (total time: 1112ms): Trace[300223409]: ---"About to write a response" 1112ms (19:58:35.437) Trace[300223409]: [1.112409212s] [1.112409212s] END I0628 19:58:35.438387 1 trace.go:236] Trace[517305508]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fc4236cf-39b0-4c0c-932a-e6eb9e73384a,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 19:58:34.672) (total time: 766ms): Trace[517305508]: ---"About to write a response" 765ms (19:58:35.438) Trace[517305508]: [766.013087ms] [766.013087ms] END I0628 19:58:35.439004 1 trace.go:236] Trace[1992457851]: "Get" accept:application/json, */*,audit-id:d8b00c88-3a9e-4b65-bf9f-72879aef8785,client:10.0.0.96,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-8d58cdbf-a0e5-482b-a39a-25df134ed133,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 19:58:34.723) (total time: 715ms): Trace[1992457851]: ---"About to write a response" 714ms (19:58:35.438) Trace[1992457851]: [715.282374ms] [715.282374ms] END I0628 19:58:36.134324 1 trace.go:236] Trace[1424407662]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:00fc3a45-54fb-4d93-a622-b90f0213caac,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/datadir-percona-xtradb-pxc-0.18bd5706352c5458,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:persistent-volume-binder,verb:PATCH (28-Jun-2026 19:58:35.391) (total time: 742ms): Trace[1424407662]: ["GuaranteedUpdate etcd3" audit-id:00fc3a45-54fb-4d93-a622-b90f0213caac,key:/events/openstack/datadir-percona-xtradb-pxc-0.18bd5706352c5458,type:*core.Event,resource:events 742ms (19:58:35.391) Trace[1424407662]: ---"Txn call completed" 694ms (19:58:36.134)] Trace[1424407662]: ---"Object stored in database" 695ms (19:58:36.134) Trace[1424407662]: [742.660229ms] [742.660229ms] END I0628 19:58:36.138792 1 trace.go:236] Trace[1032909318]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c746a33a-ec74-440e-9e8d-dcf181afeb54,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Jun-2026 19:58:35.439) (total time: 698ms): Trace[1032909318]: ["GuaranteedUpdate etcd3" audit-id:c746a33a-ec74-440e-9e8d-dcf181afeb54,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 698ms (19:58:35.439) Trace[1032909318]: ---"Txn call completed" 697ms (19:58:36.138)] Trace[1032909318]: [698.887049ms] [698.887049ms] END I0628 19:58:36.138854 1 trace.go:236] Trace[1167573884]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4d914fc9-200d-47ee-8f5a-17fcf7aa019a,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:58:35.595) (total time: 543ms): Trace[1167573884]: ["GuaranteedUpdate etcd3" audit-id:4d914fc9-200d-47ee-8f5a-17fcf7aa019a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 543ms (19:58:35.595) Trace[1167573884]: ---"Txn call completed" 542ms (19:58:36.138)] Trace[1167573884]: [543.613328ms] [543.613328ms] END I0628 19:58:36.139037 1 trace.go:236] Trace[615074209]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:95d34297-1c65-49eb-96e0-50be2b37f24f,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-8d58cdbf-a0e5-482b-a39a-25df134ed133/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 19:58:35.439) (total time: 699ms): Trace[615074209]: ["GuaranteedUpdate etcd3" audit-id:95d34297-1c65-49eb-96e0-50be2b37f24f,key:/pods/local-path-storage/helper-pod-create-pvc-8d58cdbf-a0e5-482b-a39a-25df134ed133,type:*core.Pod,resource:pods 699ms (19:58:35.439) Trace[615074209]: ---"Txn call completed" 693ms (19:58:36.138)] Trace[615074209]: ---"Object stored in database" 694ms (19:58:36.138) Trace[615074209]: [699.225186ms] [699.225186ms] END I0628 19:59:21.319345 1 trace.go:236] Trace[125452835]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:32c21068-801f-4238-9de3-9d6b31d5f4c9,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:59:20.798) (total time: 520ms): Trace[125452835]: ["GuaranteedUpdate etcd3" audit-id:32c21068-801f-4238-9de3-9d6b31d5f4c9,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 520ms (19:59:20.798) Trace[125452835]: ---"Txn call completed" 519ms (19:59:21.319)] Trace[125452835]: [520.521906ms] [520.521906ms] END I0628 19:59:28.664267 1 trace.go:236] Trace[394357447]: "Update" accept:application/json, */*,audit-id:df38ee24-6fd5-425c-817a-818d6ab3b5a7,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Jun-2026 19:59:27.960) (total time: 703ms): Trace[394357447]: ["GuaranteedUpdate etcd3" audit-id:df38ee24-6fd5-425c-817a-818d6ab3b5a7,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 703ms (19:59:27.960) Trace[394357447]: ---"Txn call completed" 702ms (19:59:28.663)] Trace[394357447]: [703.899931ms] [703.899931ms] END I0628 19:59:29.242648 1 trace.go:236] Trace[1939161025]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:20c6e020-ee2b-4dd1-8483-ddfb6991b372,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Jun-2026 19:59:27.960) (total time: 1281ms): Trace[1939161025]: ["GuaranteedUpdate etcd3" audit-id:20c6e020-ee2b-4dd1-8483-ddfb6991b372,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1281ms (19:59:27.960) Trace[1939161025]: ---"Txn call completed" 1280ms (19:59:29.242)] Trace[1939161025]: [1.281850768s] [1.281850768s] END I0628 19:59:29.242708 1 trace.go:236] Trace[304296529]: "Update" accept:application/json, */*,audit-id:5d773d18-7aa3-4eaa-a4fd-938747e8956e,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:59:27.960) (total time: 1282ms): Trace[304296529]: ["GuaranteedUpdate etcd3" audit-id:5d773d18-7aa3-4eaa-a4fd-938747e8956e,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1281ms (19:59:27.960) Trace[304296529]: ---"Txn call completed" 1280ms (19:59:29.242)] Trace[304296529]: [1.282242338s] [1.282242338s] END I0628 19:59:29.242714 1 trace.go:236] Trace[1019188653]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2d9fd9ee-714d-4e43-a778-167e98f43a7c,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:59:28.195) (total time: 1047ms): Trace[1019188653]: ["GuaranteedUpdate etcd3" audit-id:2d9fd9ee-714d-4e43-a778-167e98f43a7c,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1047ms (19:59:28.195) Trace[1019188653]: ---"Txn call completed" 1046ms (19:59:29.242)] Trace[1019188653]: [1.047326535s] [1.047326535s] END I0628 19:59:29.243068 1 trace.go:236] Trace[1199960074]: "Update" accept:application/json, */*,audit-id:1d8f4f6f-41da-4229-bb3c-36fdfa5aa438,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Jun-2026 19:59:27.959) (total time: 1282ms): Trace[1199960074]: ["GuaranteedUpdate etcd3" audit-id:1d8f4f6f-41da-4229-bb3c-36fdfa5aa438,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1282ms (19:59:27.960) Trace[1199960074]: ---"Txn call completed" 1281ms (19:59:29.242)] Trace[1199960074]: [1.282983568s] [1.282983568s] END I0628 19:59:29.243464 1 trace.go:236] Trace[55928262]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:071f58f9-8112-466c-ad07-fec2dc71beae,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 19:59:28.192) (total time: 1050ms): Trace[55928262]: ["GuaranteedUpdate etcd3" audit-id:071f58f9-8112-466c-ad07-fec2dc71beae,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1050ms (19:59:28.192) Trace[55928262]: ---"Txn call completed" 1049ms (19:59:29.242)] Trace[55928262]: [1.050679092s] [1.050679092s] END I0628 19:59:29.306171 1 trace.go:236] Trace[1059776765]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b3de3aa4-1131-4fe3-af83-2e2cc5ef99da,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (28-Jun-2026 19:59:28.243) (total time: 1062ms): Trace[1059776765]: ["GuaranteedUpdate etcd3" audit-id:b3de3aa4-1131-4fe3-af83-2e2cc5ef99da,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1062ms (19:59:28.243) Trace[1059776765]: ---"Txn call completed" 1061ms (19:59:29.305)] Trace[1059776765]: [1.062321244s] [1.062321244s] END I0628 19:59:29.308258 1 trace.go:236] Trace[1995539153]: "Get" accept:application/json,audit-id:c7793d1b-250f-4df3-be84-767d6d220187,client:199.204.45.210,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (28-Jun-2026 19:59:28.636) (total time: 671ms): Trace[1995539153]: ---"About to write a response" 669ms (19:59:29.306) Trace[1995539153]: [671.258552ms] [671.258552ms] END I0628 20:00:15.398016 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.104.47.82"} I0628 20:00:18.011124 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.96.205.131"} I0628 20:00:18.017600 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.102.123.172"} I0628 20:00:25.060695 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.104.250.246"} I0628 20:00:25.069646 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.108.162.218"} I0628 20:01:04.168489 1 trace.go:236] Trace[1789164619]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9a3f6a20-f93c-4e62-8679-870b48f84cef,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/valkey-node-0.18bd5724e48f6f0f,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Jun-2026 20:01:03.521) (total time: 647ms): Trace[1789164619]: ["GuaranteedUpdate etcd3" audit-id:9a3f6a20-f93c-4e62-8679-870b48f84cef,key:/events/openstack/valkey-node-0.18bd5724e48f6f0f,type:*core.Event,resource:events 647ms (20:01:03.521) Trace[1789164619]: ---"initial value restored" 336ms (20:01:03.858) Trace[1789164619]: ---"Txn call completed" 308ms (20:01:04.168)] Trace[1789164619]: ---"Object stored in database" 309ms (20:01:04.168) Trace[1789164619]: [647.153024ms] [647.153024ms] END I0628 20:03:08.973444 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0628 20:03:12.918179 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0628 20:03:12.951674 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0628 20:03:16.848370 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0628 20:03:16.858349 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0628 20:03:16.875569 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0628 20:03:16.885865 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 20:03:16.896559 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 20:03:16.907936 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 20:03:16.918497 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0628 20:03:19.349808 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0628 20:03:30.140986 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0628 20:03:51.658120 1 trace.go:236] Trace[1854437592]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1bb672a4-b10d-4727-9242-cf303bfbf60a,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:03:51.100) (total time: 557ms): Trace[1854437592]: ["GuaranteedUpdate etcd3" audit-id:1bb672a4-b10d-4727-9242-cf303bfbf60a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 557ms (20:03:51.100) Trace[1854437592]: ---"Txn call completed" 556ms (20:03:51.657)] Trace[1854437592]: [557.436144ms] [557.436144ms] END I0628 20:03:51.658163 1 trace.go:236] Trace[1077405693]: "Get" accept:application/json, */*,audit-id:8fe397f1-f35f-4e5b-be95-07bbd8c2ecb1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:03:51.121) (total time: 536ms): Trace[1077405693]: ---"About to write a response" 536ms (20:03:51.657) Trace[1077405693]: [536.849305ms] [536.849305ms] END I0628 20:03:51.658560 1 trace.go:236] Trace[1058501188]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3401e1fc-889f-4c37-af0c-095693de8f54,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:03:51.098) (total time: 559ms): Trace[1058501188]: ["GuaranteedUpdate etcd3" audit-id:3401e1fc-889f-4c37-af0c-095693de8f54,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 559ms (20:03:51.098) Trace[1058501188]: ---"Txn call completed" 558ms (20:03:51.657)] Trace[1058501188]: [559.8956ms] [559.8956ms] END I0628 20:04:09.251086 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0628 20:04:24.037877 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0628 20:04:24.216349 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:04:24.291483 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:04:24.297565 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:04:24.535414 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0628 20:04:24.843135 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:04:24.852513 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:04:24.952383 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0628 20:04:24.974298 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:04:25.154078 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0628 20:05:07.521530 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.100.56.232"} I0628 20:05:07.531018 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.109.183.137"} I0628 20:05:07.541402 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.110.232.222"} I0628 20:05:07.549738 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.98.251.68"} I0628 20:05:07.563858 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.106.32.212"} I0628 20:05:07.570899 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.104.24.32"} I0628 20:05:07.618314 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0628 20:05:07.632954 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0628 20:05:07.676865 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0628 20:05:07.691821 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0628 20:05:07.731883 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0628 20:05:07.754294 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.754329 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.754350 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.754366 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.754489 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.754530 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.755482 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.755519 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.755979 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.756007 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.756122 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.756141 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.756162 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.756178 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.756656 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.756685 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.756735 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.756805 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.756878 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.756896 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.757104 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.757136 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.757162 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.757205 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.757220 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.757242 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.757336 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.757358 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.757603 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.757713 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused W0628 20:05:07.759355 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused E0628 20:05:07.759380 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.110.232.222:443: connect: connection refused I0628 20:05:19.272305 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.100.142.18"} I0628 20:05:19.282420 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.106.41.209"} I0628 20:05:23.752659 1 trace.go:236] Trace[1983921847]: "Create" accept:application/json, */*,audit-id:da304ef5-46cb-49af-91be-6823a9730fb0,client:199.204.45.210,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets,user-agent:Helm/3.11.2,verb:POST (28-Jun-2026 20:05:22.147) (total time: 1605ms): Trace[1983921847]: ["Create etcd3" audit-id:da304ef5-46cb-49af-91be-6823a9730fb0,key:/secrets/monitoring/sh.helm.release.v1.vector.v1,type:*core.Secret,resource:secrets 1603ms (20:05:22.149) Trace[1983921847]: ---"Txn call succeeded" 1601ms (20:05:23.751)] Trace[1983921847]: [1.605190563s] [1.605190563s] END I0628 20:05:23.752758 1 trace.go:236] Trace[1939425170]: "Create" accept:application/json, */*,audit-id:36100116-5e57-4228-a95b-7beb694caf25,client:199.204.45.210,protocol:HTTP/2.0,resource:ciliumidentities,scope:resource,url:/apis/cilium.io/v2/ciliumidentities,user-agent:cilium-agent/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (28-Jun-2026 20:05:22.163) (total time: 1589ms): Trace[1939425170]: ["Create etcd3" audit-id:36100116-5e57-4228-a95b-7beb694caf25,key:/cilium.io/ciliumidentities/6244,type:*unstructured.Unstructured,resource:ciliumidentities.cilium.io 1588ms (20:05:22.164) Trace[1939425170]: ---"Txn call succeeded" 1586ms (20:05:23.751)] Trace[1939425170]: [1.58901866s] [1.58901866s] END I0628 20:05:23.803840 1 trace.go:236] Trace[996138005]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:148519b3-3ae3-4067-8c55-1b8d88a94748,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:05:22.308) (total time: 1494ms): Trace[996138005]: ---"About to write a response" 1494ms (20:05:23.803) Trace[996138005]: [1.494861334s] [1.494861334s] END I0628 20:05:23.804191 1 trace.go:236] Trace[2108308327]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:900726f0-7960-438c-a9a0-742cfaece3fc,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (28-Jun-2026 20:05:22.454) (total time: 1349ms): Trace[2108308327]: ["GuaranteedUpdate etcd3" audit-id:900726f0-7960-438c-a9a0-742cfaece3fc,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1349ms (20:05:22.454) Trace[2108308327]: ---"Txn call completed" 1348ms (20:05:23.803)] Trace[2108308327]: [1.349497715s] [1.349497715s] END I0628 20:05:23.854663 1 trace.go:236] Trace[1972350344]: "Get" accept:application/json, */*,audit-id:2ccca2ad-5c74-41bc-bd14-2d5de7e2c1a4,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 20:05:22.321) (total time: 1532ms): Trace[1972350344]: ---"About to write a response" 1532ms (20:05:23.854) Trace[1972350344]: [1.532734935s] [1.532734935s] END I0628 20:05:23.854688 1 trace.go:236] Trace[1898117703]: "Get" accept:application/json, */*,audit-id:03266e04-3568-42e6-8e51-d7206414b1ef,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:22.323) (total time: 1531ms): Trace[1898117703]: ---"About to write a response" 1531ms (20:05:23.854) Trace[1898117703]: [1.53133753s] [1.53133753s] END I0628 20:05:23.854809 1 trace.go:236] Trace[482741282]: "Get" accept:application/json, */*,audit-id:b57b9293-1622-4b5a-8f5a-43b8ce70d850,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:22.317) (total time: 1537ms): Trace[482741282]: ---"About to write a response" 1537ms (20:05:23.854) Trace[482741282]: [1.537512362s] [1.537512362s] END I0628 20:05:23.854865 1 trace.go:236] Trace[1337337661]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:32308ec4-e3de-4bb4-8b29-3ca216fe9e5c,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-2a85009d-76f8-4f85-a8df-2a4573c2f46d,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Jun-2026 20:05:22.475) (total time: 1379ms): Trace[1337337661]: ---"About to write a response" 1379ms (20:05:23.854) Trace[1337337661]: [1.379574264s] [1.379574264s] END I0628 20:05:23.854896 1 trace.go:236] Trace[470947596]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3311b893-0ee1-4e02-956c-9eb6860648a9,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:05:22.318) (total time: 1536ms): Trace[470947596]: ---"About to write a response" 1536ms (20:05:23.854) Trace[470947596]: [1.536627217s] [1.536627217s] END I0628 20:05:23.855447 1 trace.go:236] Trace[737937002]: "Get" accept:application/json, */*,audit-id:44c6bf5f-c8c5-4364-bf75-a5fe8deca1fa,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-wmg66,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:22.426) (total time: 1428ms): Trace[737937002]: ---"About to write a response" 1427ms (20:05:23.854) Trace[737937002]: [1.428489095s] [1.428489095s] END I0628 20:05:23.855480 1 trace.go:236] Trace[1075824201]: "Get" accept:application/json, */*,audit-id:195ef47b-9dc0-4db2-96ad-8a68e2cb6fcf,client:10.0.0.96,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-2a85009d-76f8-4f85-a8df-2a4573c2f46d,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:22.924) (total time: 930ms): Trace[1075824201]: ---"About to write a response" 930ms (20:05:23.854) Trace[1075824201]: [930.815117ms] [930.815117ms] END I0628 20:05:23.855725 1 trace.go:236] Trace[476499945]: "Get" accept:application/json, */*,audit-id:20ae126d-660f-4c23-86a4-ce78ee47d626,client:199.204.45.210,protocol:HTTP/2.0,resource:certificates,scope:resource,url:/apis/cert-manager.io/v1/namespaces/monitoring/certificates/kube-prometheus-stack-prometheus-node-exporter-4lgdg-tls,user-agent:pod-tls-sidecar/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:22.388) (total time: 1467ms): Trace[476499945]: ---"About to write a response" 1467ms (20:05:23.855) Trace[476499945]: [1.467485077s] [1.467485077s] END I0628 20:05:26.747074 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.108.32.252"} I0628 20:05:29.922606 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-smartctl-exporter" clusterIPs={"IPv4":"10.110.61.160"} I0628 20:05:32.420730 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.107.63.62"} I0628 20:05:37.831142 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.104.88.234"} I0628 20:05:38.829080 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.99.151.154"} I0628 20:05:47.022257 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0628 20:05:47.188694 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.107.30.169"} I0628 20:05:49.002958 1 trace.go:236] Trace[298069202]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6ad8b952-97de-406d-8f31-963ebe38c1c8,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:05:48.491) (total time: 511ms): Trace[298069202]: ["GuaranteedUpdate etcd3" audit-id:6ad8b952-97de-406d-8f31-963ebe38c1c8,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 511ms (20:05:48.491) Trace[298069202]: ---"Txn call completed" 510ms (20:05:49.002)] Trace[298069202]: [511.675665ms] [511.675665ms] END I0628 20:05:49.003278 1 trace.go:236] Trace[1161580839]: "Get" accept:application/json, */*,audit-id:771cda1a-95a3-4159-bea0-69f92adf6a55,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:48.451) (total time: 551ms): Trace[1161580839]: ---"About to write a response" 551ms (20:05:49.002) Trace[1161580839]: [551.95562ms] [551.95562ms] END I0628 20:05:49.003298 1 trace.go:236] Trace[1530802726]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c640a5ec-91b3-4041-b87b-386907523194,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:05:48.433) (total time: 569ms): Trace[1530802726]: ---"About to write a response" 569ms (20:05:49.003) Trace[1530802726]: [569.328566ms] [569.328566ms] END I0628 20:05:49.003524 1 trace.go:236] Trace[198610967]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2468cd87-3be7-44b4-ab1b-057967618c32,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:05:48.430) (total time: 573ms): Trace[198610967]: ["GuaranteedUpdate etcd3" audit-id:2468cd87-3be7-44b4-ab1b-057967618c32,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 572ms (20:05:48.430) Trace[198610967]: ---"Txn call completed" 572ms (20:05:49.003)] Trace[198610967]: [573.074884ms] [573.074884ms] END I0628 20:05:49.003580 1 trace.go:236] Trace[1939405951]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:730bb9b7-9ca9-47d3-971b-e6a01b7c2d70,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:05:48.491) (total time: 512ms): Trace[1939405951]: ["GuaranteedUpdate etcd3" audit-id:730bb9b7-9ca9-47d3-971b-e6a01b7c2d70,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 512ms (20:05:48.491) Trace[1939405951]: ---"Txn call completed" 511ms (20:05:49.003)] Trace[1939405951]: [512.055396ms] [512.055396ms] END I0628 20:05:49.003735 1 trace.go:236] Trace[1172978864]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3c61e9ef-f6a8-4954-994d-680669f4ba66,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:05:48.436) (total time: 567ms): Trace[1172978864]: ---"About to write a response" 567ms (20:05:49.003) Trace[1172978864]: [567.425236ms] [567.425236ms] END I0628 20:05:49.003963 1 trace.go:236] Trace[2127299179]: "Get" accept:application/json, */*,audit-id:88029e29-d51a-435f-8421-adccc47b9c97,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 20:05:48.442) (total time: 561ms): Trace[2127299179]: ---"About to write a response" 560ms (20:05:49.003) Trace[2127299179]: [561.000837ms] [561.000837ms] END I0628 20:05:49.004416 1 trace.go:236] Trace[270368330]: "Get" accept:application/json, */*,audit-id:d3d87e8e-0d69-4113-a271-eba7c983c5a6,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-wmg66,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:48.447) (total time: 557ms): Trace[270368330]: ---"About to write a response" 556ms (20:05:49.003) Trace[270368330]: [557.314351ms] [557.314351ms] END I0628 20:05:49.003965 1 trace.go:236] Trace[1797984580]: "Get" accept:application/json, */*,audit-id:00214226-c5bd-4ce6-8b68-0c87236edef1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:05:48.451) (total time: 552ms): Trace[1797984580]: ---"About to write a response" 552ms (20:05:49.003) Trace[1797984580]: [552.740971ms] [552.740971ms] END I0628 20:06:28.538172 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.99.51.58"} I0628 20:06:28.553743 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0628 20:09:32.184875 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.97.183.233"} I0628 20:10:05.983051 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.97.21.136"} I0628 20:10:44.195729 1 trace.go:236] Trace[1388358395]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b1763a09-fe19-4dea-8556-d1fcc6f306c9,client:199.204.45.210,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/barbican-ks-service/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (28-Jun-2026 20:10:43.621) (total time: 574ms): Trace[1388358395]: ["GuaranteedUpdate etcd3" audit-id:b1763a09-fe19-4dea-8556-d1fcc6f306c9,key:/jobs/openstack/barbican-ks-service,type:*batch.Job,resource:jobs.batch 574ms (20:10:43.621) Trace[1388358395]: ---"Txn call completed" 569ms (20:10:44.195)] Trace[1388358395]: [574.503955ms] [574.503955ms] END I0628 20:10:45.481262 1 trace.go:236] Trace[1427762978]: "Get" accept:application/json, */*,audit-id:5bb0028c-29de-4a53-9cdb-f76315c6ec53,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:10:44.821) (total time: 659ms): Trace[1427762978]: ---"About to write a response" 659ms (20:10:45.480) Trace[1427762978]: [659.838285ms] [659.838285ms] END I0628 20:10:45.481886 1 trace.go:236] Trace[1137687119]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2b5d5a0e-1217-488b-98ca-c3758b8854f1,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:10:44.583) (total time: 898ms): Trace[1137687119]: ["GuaranteedUpdate etcd3" audit-id:2b5d5a0e-1217-488b-98ca-c3758b8854f1,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 898ms (20:10:44.583) Trace[1137687119]: ---"Txn call completed" 897ms (20:10:45.481)] Trace[1137687119]: [898.621091ms] [898.621091ms] END I0628 20:10:45.481892 1 trace.go:236] Trace[1958879469]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7540b3be-0da6-4741-9651-035a15423fc4,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:10:44.581) (total time: 900ms): Trace[1958879469]: ["GuaranteedUpdate etcd3" audit-id:7540b3be-0da6-4741-9651-035a15423fc4,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 900ms (20:10:44.581) Trace[1958879469]: ---"Txn call completed" 898ms (20:10:45.481)] Trace[1958879469]: [900.50984ms] [900.50984ms] END I0628 20:10:45.482419 1 trace.go:236] Trace[426740117]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1c7258f5-60b3-4143-904a-02ddc0dd3809,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:10:44.376) (total time: 1105ms): Trace[426740117]: ["GuaranteedUpdate etcd3" audit-id:1c7258f5-60b3-4143-904a-02ddc0dd3809,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1105ms (20:10:44.376) Trace[426740117]: ---"Txn call completed" 1104ms (20:10:45.481)] Trace[426740117]: [1.105919096s] [1.105919096s] END I0628 20:10:45.482563 1 trace.go:236] Trace[91632212]: "Get" accept:application/json, */*,audit-id:ed320dcc-c827-4ec8-8f74-085689bf9135,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Jun-2026 20:10:44.848) (total time: 634ms): Trace[91632212]: ---"About to write a response" 633ms (20:10:45.482) Trace[91632212]: [634.084134ms] [634.084134ms] END I0628 20:10:45.482814 1 trace.go:236] Trace[189662853]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1aca7bc8-774d-4df5-852b-7d2732754bb4,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:10:44.844) (total time: 638ms): Trace[189662853]: ---"About to write a response" 638ms (20:10:45.482) Trace[189662853]: [638.656173ms] [638.656173ms] END I0628 20:10:45.483765 1 trace.go:236] Trace[703001931]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:26e72da1-1d94-460f-bfd3-5f356861c5f0,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (28-Jun-2026 20:10:44.440) (total time: 1043ms): Trace[703001931]: ["Create etcd3" audit-id:26e72da1-1d94-460f-bfd3-5f356861c5f0,key:/events/openstack/valkey-node-0.18bd57b0d0df4e47,type:*core.Event,resource:events 1042ms (20:10:44.441) Trace[703001931]: ---"Txn call succeeded" 1039ms (20:10:45.480)] Trace[703001931]: [1.043494691s] [1.043494691s] END I0628 20:10:45.484778 1 trace.go:236] Trace[609846941]: "Get" accept:application/json, */*,audit-id:23a72c8f-5fe6-42d8-b556-ac4be32f254f,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-wmg66,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:10:44.859) (total time: 625ms): Trace[609846941]: ---"About to write a response" 624ms (20:10:45.483) Trace[609846941]: [625.349306ms] [625.349306ms] END I0628 20:10:45.486574 1 trace.go:236] Trace[623769901]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:431c6106-785c-47c9-8c52-8c7620084371,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:10:44.250) (total time: 1235ms): Trace[623769901]: ["GuaranteedUpdate etcd3" audit-id:431c6106-785c-47c9-8c52-8c7620084371,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1235ms (20:10:44.251) Trace[623769901]: ---"Txn call completed" 1234ms (20:10:45.486)] Trace[623769901]: [1.235618831s] [1.235618831s] END I0628 20:10:46.377395 1 trace.go:236] Trace[684074046]: "Update" accept:application/json, */*,audit-id:9a947367-f9d7-4b8e-9b28-b40cf88e15bf,client:10.0.0.87,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:10:45.496) (total time: 880ms): Trace[684074046]: ["GuaranteedUpdate etcd3" audit-id:9a947367-f9d7-4b8e-9b28-b40cf88e15bf,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 880ms (20:10:45.496) Trace[684074046]: ---"Txn call completed" 879ms (20:10:46.376)] Trace[684074046]: [880.644782ms] [880.644782ms] END I0628 20:10:46.378307 1 trace.go:236] Trace[2014520248]: "Update" accept:application/json, */*,audit-id:677818c1-2a54-4c14-8fb7-65612a14f27d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Jun-2026 20:10:45.486) (total time: 891ms): Trace[2014520248]: ["GuaranteedUpdate etcd3" audit-id:677818c1-2a54-4c14-8fb7-65612a14f27d,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 891ms (20:10:45.486) Trace[2014520248]: ---"Txn call completed" 890ms (20:10:46.377)] Trace[2014520248]: [891.880033ms] [891.880033ms] END I0628 20:10:46.378411 1 trace.go:236] Trace[682943187]: "Update" accept:application/json, */*,audit-id:98728186-9502-4ab8-885c-20cd88ced4c1,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:10:45.484) (total time: 893ms): Trace[682943187]: ["GuaranteedUpdate etcd3" audit-id:98728186-9502-4ab8-885c-20cd88ced4c1,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 893ms (20:10:45.485) Trace[682943187]: ---"Txn call completed" 892ms (20:10:46.378)] Trace[682943187]: [893.360982ms] [893.360982ms] END I0628 20:10:46.380168 1 trace.go:236] Trace[1084964376]: "Update" accept:application/json, */*,audit-id:27ef97cb-3d53-4f5e-8e47-d7e641fc78a6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Jun-2026 20:10:45.488) (total time: 891ms): Trace[1084964376]: ["GuaranteedUpdate etcd3" audit-id:27ef97cb-3d53-4f5e-8e47-d7e641fc78a6,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 891ms (20:10:45.488) Trace[1084964376]: ---"Txn call completed" 889ms (20:10:46.379)] Trace[1084964376]: [891.677108ms] [891.677108ms] END I0628 20:10:46.380878 1 trace.go:236] Trace[462125628]: "List" accept:application/json, */*,audit-id:03362999-a9ce-4f3f-9403-5ed9447c1aff,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/openstack/pods,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (28-Jun-2026 20:10:45.491) (total time: 889ms): Trace[462125628]: ["List(recursive=true) etcd3" audit-id:03362999-a9ce-4f3f-9403-5ed9447c1aff,key:/pods/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 889ms (20:10:45.491)] Trace[462125628]: [889.475292ms] [889.475292ms] END I0628 20:12:12.135522 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0628 20:12:12.135743 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0628 20:12:12.165731 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.167650 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.190250 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.200966 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.210382 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.217763 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.228809 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.252288 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.275634 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.294727 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.303872 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.319332 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.338665 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.376720 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.416847 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.451086 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:12.544753 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0628 20:12:18.475727 1 trace.go:236] Trace[1821242881]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c45c9968-047b-4880-a643-b15172354b83,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:12:17.909) (total time: 566ms): Trace[1821242881]: ["GuaranteedUpdate etcd3" audit-id:c45c9968-047b-4880-a643-b15172354b83,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 566ms (20:12:17.909) Trace[1821242881]: ---"Txn call completed" 565ms (20:12:18.475)] Trace[1821242881]: [566.511658ms] [566.511658ms] END I0628 20:12:29.125938 1 trace.go:236] Trace[1056479699]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:15a105af-373b-45fe-b09a-c6ee0ab41d14,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:12:28.564) (total time: 561ms): Trace[1056479699]: ["GuaranteedUpdate etcd3" audit-id:15a105af-373b-45fe-b09a-c6ee0ab41d14,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 561ms (20:12:28.564) Trace[1056479699]: ---"Txn call completed" 559ms (20:12:29.125)] Trace[1056479699]: [561.16091ms] [561.16091ms] END I0628 20:12:29.126239 1 trace.go:236] Trace[1172556638]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2559fe58-2539-4381-9df2-346b26f1ee0b,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:12:28.570) (total time: 555ms): Trace[1172556638]: ---"About to write a response" 555ms (20:12:29.126) Trace[1172556638]: [555.189165ms] [555.189165ms] END I0628 20:12:29.126991 1 trace.go:236] Trace[1476972258]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2fb25f98-dd3d-4c8c-a840-10b1ec719ef8,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:12:28.565) (total time: 561ms): Trace[1476972258]: ["GuaranteedUpdate etcd3" audit-id:2fb25f98-dd3d-4c8c-a840-10b1ec719ef8,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 561ms (20:12:28.565) Trace[1476972258]: ---"Txn call completed" 560ms (20:12:29.126)] Trace[1476972258]: [561.55824ms] [561.55824ms] END I0628 20:12:29.127230 1 trace.go:236] Trace[2112614048]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4252986e-444a-4a1f-8365-7ba7c8aad8f6,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:12:28.562) (total time: 563ms): Trace[2112614048]: ["GuaranteedUpdate etcd3" audit-id:4252986e-444a-4a1f-8365-7ba7c8aad8f6,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 564ms (20:12:28.562) Trace[2112614048]: ---"Txn call completed" 562ms (20:12:29.125)] Trace[2112614048]: [563.439458ms] [563.439458ms] END I0628 20:12:54.823455 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0628 20:12:54.833510 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0628 20:13:16.112694 1 trace.go:236] Trace[2106545027]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6b48deb7-7efe-438c-af17-25277d3bce32,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:13:15.545) (total time: 567ms): Trace[2106545027]: ["GuaranteedUpdate etcd3" audit-id:6b48deb7-7efe-438c-af17-25277d3bce32,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 567ms (20:13:15.545) Trace[2106545027]: ---"Txn call completed" 566ms (20:13:16.112)] Trace[2106545027]: [567.434733ms] [567.434733ms] END I0628 20:13:16.114611 1 trace.go:236] Trace[81180993]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2679851d-c23a-4e01-8d86-bb4c314d2b59,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:13:15.559) (total time: 555ms): Trace[81180993]: ["GuaranteedUpdate etcd3" audit-id:2679851d-c23a-4e01-8d86-bb4c314d2b59,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 554ms (20:13:15.559) Trace[81180993]: ---"Txn call completed" 554ms (20:13:16.114)] Trace[81180993]: [555.045741ms] [555.045741ms] END I0628 20:13:27.806961 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.110.194.73"} I0628 20:13:31.889487 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.105.52.73"} I0628 20:14:06.082072 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.105.89.242"} I0628 20:18:41.012602 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.102.114.229"} I0628 20:19:03.854241 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-cinder" clusterIPs={"IPv4":"10.99.32.166"} I0628 20:19:38.647535 1 alloc.go:330] "allocated clusterIPs" service="openstack/cinder-api" clusterIPs={"IPv4":"10.106.2.162"} I0628 20:24:33.840931 1 alloc.go:330] "allocated clusterIPs" service="openstack/placement-api" clusterIPs={"IPv4":"10.108.232.201"} I0628 20:26:09.203163 1 trace.go:236] Trace[917206196]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4fb39997-8b7d-4392-84ce-b3ddbe38b543,client:199.204.45.210,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-glance-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Jun-2026 20:26:08.640) (total time: 562ms): Trace[917206196]: ---"About to write a response" 562ms (20:26:09.202) Trace[917206196]: [562.850553ms] [562.850553ms] END I0628 20:26:09.203636 1 trace.go:236] Trace[1222210103]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3f4efc8b-1853-472f-ad0f-a1f85cc36201,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:26:08.512) (total time: 690ms): Trace[1222210103]: ["GuaranteedUpdate etcd3" audit-id:3f4efc8b-1853-472f-ad0f-a1f85cc36201,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 690ms (20:26:08.513) Trace[1222210103]: ---"Txn call completed" 689ms (20:26:09.203)] Trace[1222210103]: [690.79887ms] [690.79887ms] END E0628 20:26:16.115445 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0628 20:26:16.115590 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0628 20:26:16.116809 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0628 20:26:16.116921 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0628 20:26:16.119741 1 trace.go:236] Trace[84130036]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:180d8574-733c-4537-8bee-73dd162ee0cd,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:26:11.118) (total time: 5001ms): Trace[84130036]: [5.001570333s] [5.001570333s] END E0628 20:26:16.119958 1 timeout.go:142] post-timeout activity - time-elapsed: 4.540638ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0628 20:26:16.139106 1 trace.go:236] Trace[2086947969]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9494ff1e-4af2-470b-b1db-a78d43db5733,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:26:11.207) (total time: 4931ms): Trace[2086947969]: ["GuaranteedUpdate etcd3" audit-id:9494ff1e-4af2-470b-b1db-a78d43db5733,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4931ms (20:26:11.207) Trace[2086947969]: ---"Txn call completed" 4930ms (20:26:16.138)] Trace[2086947969]: [4.931883871s] [4.931883871s] END I0628 20:26:16.147005 1 trace.go:236] Trace[1721252890]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7b932234-ec5d-4e3d-9c03-ad6bf9720d40,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (28-Jun-2026 20:26:14.096) (total time: 2050ms): Trace[1721252890]: ["Create etcd3" audit-id:7b932234-ec5d-4e3d-9c03-ad6bf9720d40,key:/events/kube-system/kube-apiserver-instance.18bd58893794e723,type:*core.Event,resource:events 2050ms (20:26:14.096) Trace[1721252890]: ---"Txn call succeeded" 2049ms (20:26:16.146)] Trace[1721252890]: [2.050919611s] [2.050919611s] END I0628 20:26:16.147215 1 trace.go:236] Trace[1822718287]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7562db7f-0b73-45c3-ac55-2bcb410d310b,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:26:14.094) (total time: 2053ms): Trace[1822718287]: ["GuaranteedUpdate etcd3" audit-id:7562db7f-0b73-45c3-ac55-2bcb410d310b,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2053ms (20:26:14.094) Trace[1822718287]: ---"Txn call completed" 2045ms (20:26:16.146)] Trace[1822718287]: [2.053122848s] [2.053122848s] END I0628 20:26:16.147671 1 trace.go:236] Trace[586665636]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:06dcb76b-eccb-4120-980a-0c403476af1c,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:26:14.099) (total time: 2048ms): Trace[586665636]: ["GuaranteedUpdate etcd3" audit-id:06dcb76b-eccb-4120-980a-0c403476af1c,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2048ms (20:26:14.099) Trace[586665636]: ---"Txn call completed" 2047ms (20:26:16.147)] Trace[586665636]: [2.048526118s] [2.048526118s] END I0628 20:26:16.147965 1 trace.go:236] Trace[1706293971]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d74f0ce4-6eca-40e2-8903-107502c9528f,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:26:13.393) (total time: 2754ms): Trace[1706293971]: ["GuaranteedUpdate etcd3" audit-id:d74f0ce4-6eca-40e2-8903-107502c9528f,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2754ms (20:26:13.393) Trace[1706293971]: ---"Txn call completed" 2753ms (20:26:16.147)] Trace[1706293971]: [2.754636785s] [2.754636785s] END I0628 20:26:16.178513 1 trace.go:236] Trace[909186372]: "Get" accept:application/json, */*,audit-id:3ec1c674-e992-4a79-8815-d494623169ee,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:26:11.220) (total time: 4957ms): Trace[909186372]: ---"About to write a response" 4957ms (20:26:16.178) Trace[909186372]: [4.957835362s] [4.957835362s] END I0628 20:26:16.178870 1 trace.go:236] Trace[1496735776]: "Get" accept:application/json, */*,audit-id:77d7d05a-e035-4829-a17c-25ba2b5f6df6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:26:11.227) (total time: 4950ms): Trace[1496735776]: ---"About to write a response" 4950ms (20:26:16.178) Trace[1496735776]: [4.950882142s] [4.950882142s] END I0628 20:26:16.179691 1 trace.go:236] Trace[1338878270]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:04effb46-f57b-4070-999c-2d8ebf0b95c9,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:26:11.221) (total time: 4958ms): Trace[1338878270]: ---"About to write a response" 4958ms (20:26:16.179) Trace[1338878270]: [4.958460928s] [4.958460928s] END I0628 20:26:16.187984 1 trace.go:236] Trace[2029089724]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7ded3019-1e40-4353-bc3a-abf3ac2db191,client:199.204.45.210,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (28-Jun-2026 20:26:12.400) (total time: 3787ms): Trace[2029089724]: ---"About to write a response" 3787ms (20:26:16.187) Trace[2029089724]: [3.787674411s] [3.787674411s] END I0628 20:26:16.188956 1 trace.go:236] Trace[1349927983]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a2bf0e32-b7ef-4372-89e5-7358b17fa2b0,client:10.0.0.247,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:26:11.985) (total time: 4203ms): Trace[1349927983]: ---"About to write a response" 4203ms (20:26:16.188) Trace[1349927983]: [4.203478005s] [4.203478005s] END I0628 20:26:16.193998 1 trace.go:236] Trace[2009715109]: "List" accept:application/json, */*,audit-id:59f94e04-57ab-44e3-995e-a7b0d2f39d70,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/openstack/pods,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (28-Jun-2026 20:26:11.317) (total time: 4876ms): Trace[2009715109]: ["List(recursive=true) etcd3" audit-id:59f94e04-57ab-44e3-995e-a7b0d2f39d70,key:/pods/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 4876ms (20:26:11.317)] Trace[2009715109]: [4.876683443s] [4.876683443s] END I0628 20:27:30.112093 1 alloc.go:330] "allocated clusterIPs" service="openstack/ovn-ovsdb-nb" clusterIPs={"IPv4":"10.109.253.43"} I0628 20:27:30.120525 1 alloc.go:330] "allocated clusterIPs" service="openstack/ovn-ovsdb-sb" clusterIPs={"IPv4":"10.99.205.63"} I0628 20:27:45.387402 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-nova" clusterIPs={"IPv4":"10.104.25.174"} I0628 20:28:24.370984 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-metadata" clusterIPs={"IPv4":"10.111.50.150"} I0628 20:28:24.381301 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-novncproxy" clusterIPs={"IPv4":"10.101.123.31"} I0628 20:28:24.402291 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-api" clusterIPs={"IPv4":"10.108.241.237"} I0628 20:29:05.994321 1 trace.go:236] Trace[1578130834]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c040a56f-86a1-4560-b383-38b18d27e9a4,client:10.0.0.247,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:29:04.975) (total time: 1018ms): Trace[1578130834]: ["GuaranteedUpdate etcd3" audit-id:c040a56f-86a1-4560-b383-38b18d27e9a4,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1018ms (20:29:04.976) Trace[1578130834]: ---"Txn call completed" 1016ms (20:29:05.993)] Trace[1578130834]: [1.018250892s] [1.018250892s] END I0628 20:29:06.015249 1 trace.go:236] Trace[251096665]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:059f4a16-1b4b-4428-8637-9e1d84b9f48c,client:10.0.0.67,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:29:04.978) (total time: 1036ms): Trace[251096665]: ["GuaranteedUpdate etcd3" audit-id:059f4a16-1b4b-4428-8637-9e1d84b9f48c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1036ms (20:29:04.978) Trace[251096665]: ---"Txn call completed" 1035ms (20:29:06.015)] Trace[251096665]: [1.036417343s] [1.036417343s] END I0628 20:29:06.016979 1 trace.go:236] Trace[1618135773]: "Get" accept:application/json, */*,audit-id:7af368f7-b055-4d22-8c68-e84c4b7f0d18,client:199.204.45.210,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:29:05.191) (total time: 825ms): Trace[1618135773]: [825.937924ms] [825.937924ms] END I0628 20:29:06.017470 1 trace.go:236] Trace[225554535]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:26f7de05-497a-413e-85ac-4d3a388becf3,client:10.0.0.247,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments/percona-xtradb-pitr,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (28-Jun-2026 20:29:05.041) (total time: 975ms): Trace[225554535]: [975.879733ms] [975.879733ms] END I0628 20:29:06.017876 1 trace.go:236] Trace[2031061399]: "Get" accept:application/json, */*,audit-id:b03566fd-de93-4e81-9e72-322e913ad462,client:199.204.45.210,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:29:05.192) (total time: 825ms): Trace[2031061399]: ---"About to write a response" 825ms (20:29:06.017) Trace[2031061399]: [825.219854ms] [825.219854ms] END I0628 20:29:06.018216 1 trace.go:236] Trace[238982135]: "Get" accept:application/json, */*,audit-id:64ca4cce-a676-4585-a156-b8268778f003,client:199.204.45.210,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:29:05.189) (total time: 828ms): Trace[238982135]: [828.327395ms] [828.327395ms] END I0628 20:29:06.018379 1 trace.go:236] Trace[443636889]: "Get" accept:application/json, */*,audit-id:134fab24-6a18-48f2-832a-239ebf6bd542,client:199.204.45.210,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-metadata,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:29:05.191) (total time: 826ms): Trace[443636889]: ---"About to write a response" 826ms (20:29:06.017) Trace[443636889]: [826.458267ms] [826.458267ms] END I0628 20:29:06.019148 1 trace.go:236] Trace[574224463]: "Get" accept:application/json, */*,audit-id:a79f4897-1826-408d-938c-32b3412c257a,client:10.0.0.172,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:29:05.297) (total time: 721ms): Trace[574224463]: ---"About to write a response" 720ms (20:29:06.018) Trace[574224463]: [721.272858ms] [721.272858ms] END I0628 20:29:06.019921 1 trace.go:236] Trace[159708213]: "Get" accept:application/json, */*,audit-id:c6990d04-7b09-4ba3-9c7f-d8b0dabb48d8,client:199.204.45.210,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Jun-2026 20:29:05.191) (total time: 828ms): Trace[159708213]: ---"About to write a response" 826ms (20:29:06.018) Trace[159708213]: [828.015417ms] [828.015417ms] END I0628 20:29:06.026008 1 trace.go:236] Trace[312327004]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ad9ba19b-8584-44ea-abdd-6ca6137db864,client:10.0.0.184,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:29:04.978) (total time: 1047ms): Trace[312327004]: ["GuaranteedUpdate etcd3" audit-id:ad9ba19b-8584-44ea-abdd-6ca6137db864,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1047ms (20:29:04.978) Trace[312327004]: ---"Txn call completed" 1046ms (20:29:06.025)] Trace[312327004]: [1.047418458s] [1.047418458s] END I0628 20:29:06.026662 1 trace.go:236] Trace[386792770]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:562fecb4-77d2-4253-8a55-389319daf16b,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Jun-2026 20:29:05.412) (total time: 614ms): Trace[386792770]: ---"About to write a response" 614ms (20:29:06.026) Trace[386792770]: [614.494959ms] [614.494959ms] END I0628 20:29:06.026684 1 trace.go:236] Trace[951358100]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:07c63f66-b4a7-4bc6-a1eb-cd827a8472d7,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Jun-2026 20:29:04.978) (total time: 1047ms): Trace[951358100]: ["GuaranteedUpdate etcd3" audit-id:07c63f66-b4a7-4bc6-a1eb-cd827a8472d7,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1047ms (20:29:04.978) Trace[951358100]: ---"Txn call completed" 1046ms (20:29:06.026)] Trace[951358100]: [1.047779828s] [1.047779828s] END