I0629 00:20:27.866106 1 options.go:220] external host was not specified, using 199.204.45.246 I0629 00:20:27.867002 1 server.go:148] Version: v1.28.13 I0629 00:20:27.867084 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0629 00:20:28.732684 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0629 00:20:28.740384 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0629 00:20:28.740419 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0629 00:20:28.740595 1 instance.go:298] Using reconciler: lease I0629 00:20:28.785462 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0629 00:20:28.785483 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0629 00:20:29.044801 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0629 00:20:29.045233 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0629 00:20:29.500128 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0629 00:20:29.524664 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0629 00:20:29.524701 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.524712 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.525404 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0629 00:20:29.525425 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0629 00:20:29.526809 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0629 00:20:29.527599 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0629 00:20:29.527611 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0629 00:20:29.527615 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0629 00:20:29.528817 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0629 00:20:29.528831 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0629 00:20:29.529637 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0629 00:20:29.529650 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.529654 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.530170 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0629 00:20:29.530182 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.530223 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0629 00:20:29.530711 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0629 00:20:29.532191 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0629 00:20:29.532204 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.532207 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.532610 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0629 00:20:29.532620 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.532624 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.533299 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0629 00:20:29.533311 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0629 00:20:29.534883 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0629 00:20:29.534896 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.534900 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.535302 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0629 00:20:29.535314 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.535318 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.536958 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0629 00:20:29.536970 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.536974 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.537944 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0629 00:20:29.539092 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0629 00:20:29.539105 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.539108 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.541863 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0629 00:20:29.541878 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0629 00:20:29.541882 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0629 00:20:29.542811 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0629 00:20:29.542824 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0629 00:20:29.542829 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0629 00:20:29.543317 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0629 00:20:29.543333 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0629 00:20:29.571711 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0629 00:20:29.571737 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0629 00:20:29.963950 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0629 00:20:29.964002 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0629 00:20:29.964217 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0629 00:20:29.964442 1 secure_serving.go:213] Serving securely on [::]:6443 I0629 00:20:29.964624 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0629 00:20:29.964653 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0629 00:20:29.964652 1 controller.go:80] Starting OpenAPI V3 AggregationController I0629 00:20:29.964700 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0629 00:20:29.964711 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0629 00:20:29.964740 1 controller.go:78] Starting OpenAPI AggregationController I0629 00:20:29.964664 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0629 00:20:29.964775 1 available_controller.go:423] Starting AvailableConditionController I0629 00:20:29.964787 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0629 00:20:29.964823 1 system_namespaces_controller.go:67] Starting system namespaces controller I0629 00:20:29.964839 1 gc_controller.go:78] Starting apiserver lease garbage collector I0629 00:20:29.964910 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0629 00:20:29.964952 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0629 00:20:29.964996 1 gc_controller.go:78] Starting apiserver lease garbage collector I0629 00:20:29.965006 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0629 00:20:29.965046 1 aggregator.go:164] waiting for initial CRD sync... I0629 00:20:29.965099 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0629 00:20:29.964788 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0629 00:20:29.965137 1 controller.go:85] Starting OpenAPI V3 controller I0629 00:20:29.965192 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0629 00:20:29.965234 1 controller.go:134] Starting OpenAPI controller I0629 00:20:29.965368 1 controller.go:116] Starting legacy_token_tracking_controller I0629 00:20:29.965388 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0629 00:20:29.965440 1 naming_controller.go:291] Starting NamingConditionController I0629 00:20:29.965471 1 establishing_controller.go:76] Starting EstablishingController I0629 00:20:29.965496 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0629 00:20:29.965515 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0629 00:20:29.965540 1 crd_finalizer.go:266] Starting CRDFinalizer I0629 00:20:29.965570 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0629 00:20:29.965582 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0629 00:20:30.032887 1 shared_informer.go:318] Caches are synced for node_authorizer E0629 00:20:30.035427 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0629 00:20:30.064766 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0629 00:20:30.064822 1 apf_controller.go:379] Running API Priority and Fairness config worker I0629 00:20:30.064835 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0629 00:20:30.065210 1 cache.go:39] Caches are synced for AvailableConditionController controller I0629 00:20:30.065210 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0629 00:20:30.065432 1 shared_informer.go:318] Caches are synced for configmaps I0629 00:20:30.065673 1 shared_informer.go:318] Caches are synced for crd-autoregister I0629 00:20:30.065780 1 aggregator.go:166] initial CRD sync complete... I0629 00:20:30.065807 1 autoregister_controller.go:141] Starting autoregister controller I0629 00:20:30.065823 1 cache.go:32] Waiting for caches to sync for autoregister controller I0629 00:20:30.065838 1 cache.go:39] Caches are synced for autoregister controller I0629 00:20:30.067244 1 controller.go:624] quota admission added evaluator for: namespaces I0629 00:20:30.238631 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0629 00:20:30.973516 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0629 00:20:30.979571 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0629 00:20:30.979589 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0629 00:20:31.525296 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0629 00:20:31.578980 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0629 00:20:31.680717 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0629 00:20:31.693949 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.246] I0629 00:20:31.695447 1 controller.go:624] quota admission added evaluator for: endpoints I0629 00:20:31.701314 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0629 00:20:33.145142 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0629 00:20:33.569401 1 controller.go:624] quota admission added evaluator for: deployments.apps I0629 00:20:33.619836 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0629 00:20:33.819811 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0629 00:20:38.136950 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0629 00:20:38.388007 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0629 00:21:04.986496 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0629 00:21:05.009296 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0629 00:21:05.042610 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0629 00:21:05.042961 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0629 00:21:05.067119 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0629 00:21:05.067309 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0629 00:21:05.081600 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0629 00:21:05.109912 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0629 00:21:05.109955 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0629 00:21:05.145260 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0629 00:21:05.190146 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0629 00:21:05.190180 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0629 00:21:05.203715 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0629 00:21:05.216409 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0629 00:21:05.216478 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0629 00:21:05.343715 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0629 00:21:05.343772 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0629 00:21:05.357481 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:05.422935 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:05.453413 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:05.484938 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:05.502534 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:06.179224 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:06.273665 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0629 00:21:11.734285 1 controller.go:624] quota admission added evaluator for: jobs.batch I0629 00:21:12.830097 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0629 00:21:12.840088 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0629 00:21:13.021456 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0629 00:21:13.223356 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0629 00:21:13.433979 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0629 00:21:13.634165 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0629 00:21:14.106781 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0629 00:21:14.309012 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0629 00:21:15.689583 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0629 00:21:16.406712 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0629 00:21:16.802375 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0629 00:21:17.485696 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0629 00:21:17.485735 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0629 00:21:20.981003 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0629 00:21:29.957420 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.109.115.72"} W0629 00:21:31.259288 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.115.72:9443: connect: connection refused E0629 00:21:31.259342 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.115.72:9443: connect: connection refused I0629 00:21:42.742414 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0629 00:21:42.749881 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0629 00:21:42.761339 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0629 00:21:42.793914 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.111.21.94"} I0629 00:21:42.825496 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.99.192.1"} I0629 00:21:42.826358 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0629 00:21:42.876373 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0629 00:21:42.919274 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0629 00:21:48.189251 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.111.21.94:443: connect: connection refused W0629 00:21:53.176188 1 dispatcher.go:217] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": dial tcp 10.111.21.94:443: connect: connection refused I0629 00:21:58.187005 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0629 00:22:03.868893 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0629 00:22:18.250380 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.110.167.142"} I0629 00:22:18.261773 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.99.100.30"} I0629 00:22:18.269278 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.160.110"} I0629 00:22:18.278609 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.107.84.11"} I0629 00:22:24.684103 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.701817 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.723451 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.737062 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.755193 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.772155 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.787163 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.805676 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.860869 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.867571 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0629 00:22:24.884686 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.905017 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:24.926839 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:26.197602 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0629 00:22:29.858200 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0629 00:22:29.863412 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0629 00:22:29.915457 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.106.42.134"} I0629 00:22:29.937152 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0629 00:22:32.136882 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0629 00:22:32.160114 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0629 00:22:32.753736 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0629 00:22:32.753784 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0629 00:22:32.753830 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0629 00:22:39.249794 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0629 00:22:41.871466 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.96.152.38"} I0629 00:22:42.142387 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0629 00:22:42.395499 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.109.84.178"} I0629 00:22:42.409518 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.98.66.101"} I0629 00:24:13.863155 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.104.97.190"} I0629 00:24:16.313176 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.111.100.110"} I0629 00:24:16.322100 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.100.24.244"} I0629 00:24:23.102665 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.104.73.42"} I0629 00:24:23.111961 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.104.39.207"} I0629 00:26:42.969844 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0629 00:26:46.765903 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0629 00:26:46.787788 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0629 00:26:50.579142 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0629 00:26:50.589147 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0629 00:26:50.608816 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0629 00:26:50.623814 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0629 00:26:50.636467 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0629 00:26:50.647121 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0629 00:26:50.661675 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0629 00:26:53.533388 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0629 00:27:02.669892 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0629 00:27:41.530854 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0629 00:27:56.466380 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0629 00:27:56.679285 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0629 00:27:56.692028 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0629 00:27:56.712357 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0629 00:27:56.947667 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0629 00:27:57.237784 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0629 00:27:57.345635 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0629 00:27:57.384959 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0629 00:27:57.484602 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0629 00:28:36.053582 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.110.18.146"} I0629 00:28:36.061787 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.96.137.149"} I0629 00:28:36.068057 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.101.179.244"} I0629 00:28:36.076449 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.111.82.195"} I0629 00:28:36.084728 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.108.115.30"} I0629 00:28:36.117260 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.102.178.94"} I0629 00:28:36.156906 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0629 00:28:36.170743 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0629 00:28:36.201366 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0629 00:28:36.221385 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0629 00:28:36.246483 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0629 00:28:36.255575 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.255626 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.256452 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.256489 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.256493 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.256518 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.256795 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.256870 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.256877 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.256903 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.256924 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.256946 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.256983 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.256955 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.257451 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.257475 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.257691 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.257716 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.257811 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.257861 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.257902 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.257925 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.257978 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.258029 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.258567 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.258592 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.258605 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.258631 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.258674 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.258641 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused W0629 00:28:36.259612 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused E0629 00:28:36.259635 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.101.179.244:443: connect: connection refused I0629 00:28:46.703957 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.103.184.254"} I0629 00:28:46.724077 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.99.215.181"} I0629 00:28:50.923259 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.109.36.242"} I0629 00:28:53.690835 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-smartctl-exporter" clusterIPs={"IPv4":"10.103.63.6"} I0629 00:28:55.597194 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.111.133.124"} I0629 00:29:00.216142 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.111.28.235"} I0629 00:29:01.074816 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.97.79.154"} I0629 00:29:07.908226 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0629 00:29:08.071483 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.60.153"} I0629 00:29:48.909374 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.96.85.121"} I0629 00:29:48.921530 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0629 00:32:53.911720 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.106.51.49"} I0629 00:33:27.218974 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.98.42.229"} I0629 00:35:19.702104 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0629 00:35:19.715383 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.736915 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.743426 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.751676 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.759793 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.766124 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.781884 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.789431 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0629 00:35:19.798068 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.808014 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.822916 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.837377 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.854708 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.864584 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.898354 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.938135 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:19.975653 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:20.097912 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0629 00:35:59.460795 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0629 00:35:59.470544 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0629 00:36:32.509764 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.100.65.227"} I0629 00:36:34.068509 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.109.11.18"} I0629 00:37:07.857875 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.103.209.216"} I0629 00:39:47.926751 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.100.20.23"} I0629 00:40:09.110139 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-cinder" clusterIPs={"IPv4":"10.109.20.4"} I0629 00:40:43.437373 1 alloc.go:330] "allocated clusterIPs" service="openstack/cinder-api" clusterIPs={"IPv4":"10.107.50.249"} I0629 00:45:36.319593 1 alloc.go:330] "allocated clusterIPs" service="openstack/placement-api" clusterIPs={"IPv4":"10.107.115.63"} I0629 00:48:10.215852 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-coredns" clusterIPs={"IPv4":"10.96.0.20"} I0629 00:48:10.224924 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-coredns-metrics" clusterIPs={"IPv4":"10.104.194.20"} I0629 00:48:14.326943 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-nova" clusterIPs={"IPv4":"10.110.188.64"} I0629 00:48:38.202764 1 trace.go:236] Trace[1313673991]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3a941b54-4764-4bbe-abd2-3cb326e46072,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/barbican-api-85885b5c79-qxjr6.18bd662090b76ba1,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Jun-2026 00:48:37.561) (total time: 640ms): Trace[1313673991]: ["GuaranteedUpdate etcd3" audit-id:3a941b54-4764-4bbe-abd2-3cb326e46072,key:/events/openstack/barbican-api-85885b5c79-qxjr6.18bd662090b76ba1,type:*core.Event,resource:events 640ms (00:48:37.561) Trace[1313673991]: ---"Txn call completed" 638ms (00:48:38.202)] Trace[1313673991]: ---"Object stored in database" 639ms (00:48:38.202) Trace[1313673991]: [640.798234ms] [640.798234ms] END I0629 00:48:38.202859 1 trace.go:236] Trace[169790201]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:20fcd73c-33cc-4cf1-b661-19832871c4aa,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Jun-2026 00:48:37.701) (total time: 501ms): Trace[169790201]: ---"About to write a response" 501ms (00:48:38.202) Trace[169790201]: [501.328132ms] [501.328132ms] END I0629 00:48:43.342389 1 trace.go:236] Trace[1471469247]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2c3704f4-43f2-4357-89bb-fd8b8b297b61,client:10.0.0.146,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:48:40.163) (total time: 3178ms): Trace[1471469247]: ---"About to write a response" 3178ms (00:48:43.341) Trace[1471469247]: [3.178732466s] [3.178732466s] END I0629 00:48:43.343589 1 trace.go:236] Trace[1457944522]: "Get" accept:application/json,audit-id:25fcef05-90b0-4103-8b2b-9578ba84eff8,client:199.204.45.246,protocol:HTTP/1.1,resource:rabbitmqclusters,scope:resource,url:/apis/rabbitmq.com/v1beta1/namespaces/openstack/rabbitmqclusters/rabbitmq-nova,user-agent:OpenAPI-Generator/36.0.2/python,verb:GET (29-Jun-2026 00:48:39.317) (total time: 4025ms): Trace[1457944522]: ---"About to write a response" 4025ms (00:48:43.343) Trace[1457944522]: [4.025815781s] [4.025815781s] END I0629 00:48:43.393330 1 trace.go:236] Trace[111946418]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:58f864e9-5b58-4777-8208-b64a48dbe2c2,client:10.0.0.146,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:48:40.207) (total time: 3185ms): Trace[111946418]: ["GuaranteedUpdate etcd3" audit-id:58f864e9-5b58-4777-8208-b64a48dbe2c2,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 3185ms (00:48:40.208) Trace[111946418]: ---"Txn call completed" 3184ms (00:48:43.393)] Trace[111946418]: [3.185299379s] [3.185299379s] END I0629 00:48:43.543994 1 trace.go:236] Trace[1506588271]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:14fbab01-5353-450c-a652-63d464e89079,client:10.0.0.200,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:48:40.208) (total time: 3335ms): Trace[1506588271]: ["GuaranteedUpdate etcd3" audit-id:14fbab01-5353-450c-a652-63d464e89079,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3335ms (00:48:40.208) Trace[1506588271]: ---"Txn call completed" 3334ms (00:48:43.543)] Trace[1506588271]: [3.335300214s] [3.335300214s] END I0629 00:48:43.544057 1 trace.go:236] Trace[496703815]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:189b768b-13b3-4d0d-a039-6a795014b022,client:10.0.0.211,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:48:41.135) (total time: 2408ms): Trace[496703815]: ["GuaranteedUpdate etcd3" audit-id:189b768b-13b3-4d0d-a039-6a795014b022,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2408ms (00:48:41.135) Trace[496703815]: ---"Txn call completed" 2407ms (00:48:43.543)] Trace[496703815]: [2.408659197s] [2.408659197s] END I0629 00:48:43.544241 1 trace.go:236] Trace[222963325]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cc4feddb-b096-4fc3-b4d3-4ea2e54b7634,client:10.0.0.154,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:48:41.134) (total time: 2409ms): Trace[222963325]: ["GuaranteedUpdate etcd3" audit-id:cc4feddb-b096-4fc3-b4d3-4ea2e54b7634,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 2409ms (00:48:41.134) Trace[222963325]: ---"Txn call completed" 2407ms (00:48:43.544)] Trace[222963325]: [2.409423862s] [2.409423862s] END I0629 00:48:43.544921 1 trace.go:236] Trace[1599454238]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:eec76427-8e6b-4229-8e50-e207ed979fa5,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-Jun-2026 00:48:41.274) (total time: 2270ms): Trace[1599454238]: ["GuaranteedUpdate etcd3" audit-id:eec76427-8e6b-4229-8e50-e207ed979fa5,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 2270ms (00:48:41.274) Trace[1599454238]: ---"Txn call completed" 2269ms (00:48:43.544)] Trace[1599454238]: [2.270811078s] [2.270811078s] END I0629 00:48:43.545013 1 trace.go:236] Trace[196042466]: "Get" accept:application/json, */*,audit-id:2251fe78-96e4-48ca-8229-0452661aaca6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:48:40.214) (total time: 3330ms): Trace[196042466]: ---"About to write a response" 3330ms (00:48:43.544) Trace[196042466]: [3.3307273s] [3.3307273s] END I0629 00:48:43.545666 1 trace.go:236] Trace[24114780]: "Get" accept:application/json, */*,audit-id:f0fa08c1-4d2f-495f-ada9-c6a72a8ebdc0,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:48:40.212) (total time: 3333ms): Trace[24114780]: ---"About to write a response" 3333ms (00:48:43.545) Trace[24114780]: [3.333280951s] [3.333280951s] END I0629 00:48:43.545689 1 trace.go:236] Trace[1052964850]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0ff653f0-3f21-440f-b47c-73677da4bd9f,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:48:41.147) (total time: 2398ms): Trace[1052964850]: ---"About to write a response" 2398ms (00:48:43.545) Trace[1052964850]: [2.398463021s] [2.398463021s] END I0629 00:48:43.545768 1 trace.go:236] Trace[570553700]: "Get" accept:application/json, */*,audit-id:417f5e86-b1d8-4e02-b292-4e9a958b3c7d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:48:40.214) (total time: 3331ms): Trace[570553700]: ---"About to write a response" 3331ms (00:48:43.545) Trace[570553700]: [3.331384903s] [3.331384903s] END I0629 00:48:43.545801 1 trace.go:236] Trace[574704380]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:445436d2-de7c-4649-9ed3-aa785e215895,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:48:41.120) (total time: 2425ms): Trace[574704380]: ---"About to write a response" 2424ms (00:48:43.545) Trace[574704380]: [2.425005477s] [2.425005477s] END I0629 00:48:43.546580 1 trace.go:236] Trace[442817802]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8b93ffa0-3842-4a5a-ae7c-a54fe9f5aec4,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-glance-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Jun-2026 00:48:40.647) (total time: 2898ms): Trace[442817802]: ---"About to write a response" 2898ms (00:48:43.545) Trace[442817802]: [2.898568187s] [2.898568187s] END I0629 00:48:43.547228 1 trace.go:236] Trace[720054085]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:93c76657-dd46-4993-9837-74dde6617eb6,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rabbitmq-nova-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Jun-2026 00:48:40.756) (total time: 2790ms): Trace[720054085]: ---"About to write a response" 2789ms (00:48:43.546) Trace[720054085]: [2.790189145s] [2.790189145s] END I0629 00:48:43.547717 1 trace.go:236] Trace[1671237631]: "Get" accept:application/json, */*,audit-id:d8a1ff40-f8cf-4fba-a6f2-d252944b367a,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-skfw8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:48:40.659) (total time: 2887ms): Trace[1671237631]: ---"About to write a response" 2887ms (00:48:43.546) Trace[1671237631]: [2.8877963s] [2.8877963s] END I0629 00:48:43.548802 1 trace.go:236] Trace[309823214]: "Get" accept:application/json, */*,audit-id:1acb42aa-0b2f-4cd7-841c-b1b75e232cee,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/libvirt-libvirt-default-2hfbm,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:48:41.143) (total time: 2405ms): Trace[309823214]: ---"About to write a response" 2404ms (00:48:43.547) Trace[309823214]: [2.405490842s] [2.405490842s] END I0629 00:48:43.763936 1 trace.go:236] Trace[287959585]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (29-Jun-2026 00:48:41.781) (total time: 1982ms): Trace[287959585]: ---"initial value restored" 1764ms (00:48:43.545) Trace[287959585]: ---"Txn call completed" 186ms (00:48:43.763) Trace[287959585]: [1.982560188s] [1.982560188s] END I0629 00:48:56.271811 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-api" clusterIPs={"IPv4":"10.97.239.132"} I0629 00:48:56.280493 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-metadata" clusterIPs={"IPv4":"10.100.225.212"} I0629 00:48:56.289867 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-novncproxy" clusterIPs={"IPv4":"10.105.216.82"} E0629 00:49:14.643677 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:14.643729 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:14.643802 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 60.561µs, panicked: false, err: context canceled, panic-reason: E0629 00:49:14.644978 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:14.645024 1 trace.go:236] Trace[20555571]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cde03616-78f1-49ae-aa6e-27510eda617b,client:10.0.0.154,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:49:09.643) (total time: 5001ms): Trace[20555571]: ["GuaranteedUpdate etcd3" audit-id:cde03616-78f1-49ae-aa6e-27510eda617b,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (00:49:09.644) Trace[20555571]: ---"Txn call failed" err:context canceled 4998ms (00:49:14.643)] Trace[20555571]: [5.001573302s] [5.001573302s] END E0629 00:49:14.645095 1 timeout.go:142] post-timeout activity - time-elapsed: 1.278456ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0629 00:49:14.874780 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:14.874929 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:14.876045 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:14.876113 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0629 00:49:14.876052 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:14.877637 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:14.877655 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0629 00:49:14.877670 1 trace.go:236] Trace[961424834]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4457d755-710c-4246-8db3-31f0f7cfa3a5,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:09.874) (total time: 5003ms): Trace[961424834]: [5.003297915s] [5.003297915s] END E0629 00:49:14.877819 1 timeout.go:142] post-timeout activity - time-elapsed: 3.079532ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0629 00:49:14.878977 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:14.879053 1 trace.go:236] Trace[519050740]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6a0418ef-5a59-4ea9-bd17-c1c855f60fa2,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:09.875) (total time: 5003ms): Trace[519050740]: [5.003312996s] [5.003312996s] END E0629 00:49:14.879238 1 timeout.go:142] post-timeout activity - time-elapsed: 3.170764ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0629 00:49:14.881133 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:14.881196 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:14.882305 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:14.882329 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:14.883457 1 trace.go:236] Trace[852203533]: "Get" accept:application/json, */*,audit-id:5068455b-5500-44ee-8b7a-842ff74216db,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:09.881) (total time: 5002ms): Trace[852203533]: [5.002334697s] [5.002334697s] END E0629 00:49:14.883575 1 timeout.go:142] post-timeout activity - time-elapsed: 2.387479ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0629 00:49:16.479227 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:16.479339 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:16.480300 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:16.480461 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:16.482366 1 trace.go:236] Trace[2018600729]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f9881503-454b-43bf-b0d0-cfa45122fcd2,client:10.0.0.146,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:49:11.476) (total time: 5006ms): Trace[2018600729]: ["GuaranteedUpdate etcd3" audit-id:f9881503-454b-43bf-b0d0-cfa45122fcd2,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5005ms (00:49:11.476) Trace[2018600729]: ---"Txn call failed" err:etcdserver: request timed out 5001ms (00:49:16.479)] Trace[2018600729]: [5.006123823s] [5.006123823s] END E0629 00:49:16.482456 1 timeout.go:142] post-timeout activity - time-elapsed: 3.077732ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0629 00:49:16.638011 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:16.638055 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:16.638086 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.79µs, panicked: false, err: context deadline exceeded, panic-reason: E0629 00:49:16.639328 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:16.639439 1 trace.go:236] Trace[1429459520]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cd113f9a-a79f-430b-a238-1a547d9abb81,client:10.0.0.200,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:49:11.637) (total time: 5001ms): Trace[1429459520]: ["GuaranteedUpdate etcd3" audit-id:cd113f9a-a79f-430b-a238-1a547d9abb81,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (00:49:11.638) Trace[1429459520]: ---"Txn call failed" err:context deadline exceeded 4999ms (00:49:16.637)] Trace[1429459520]: [5.00149785s] [5.00149785s] END E0629 00:49:16.639642 1 timeout.go:142] post-timeout activity - time-elapsed: 1.500911ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0629 00:49:16.648012 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election?timeout=5s" audit-ID="f7dca712-cd11-4bac-a77a-0b6d27235d27" I0629 00:49:16.648031 1 trace.go:236] Trace[213197647]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f7dca712-cd11-4bac-a77a-0b6d27235d27,client:10.0.0.211,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:49:11.648) (total time: 4999ms): Trace[213197647]: ["GuaranteedUpdate etcd3" audit-id:f7dca712-cd11-4bac-a77a-0b6d27235d27,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (00:49:11.648) Trace[213197647]: ---"Txn call failed" err:context canceled 4998ms (00:49:16.647)] Trace[213197647]: [4.999366616s] [4.999366616s] END E0629 00:49:16.648144 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.79µs, panicked: false, err: context canceled, panic-reason: E0629 00:49:16.648275 1 timeout.go:142] post-timeout activity - time-elapsed: 57.161µs, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0629 00:49:16.690277 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:16.690436 1 trace.go:236] Trace[78393701]: "Get" accept:application/json, */*,audit-id:054066de-514d-406a-9693-e5f459964b30,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.688) (total time: 7002ms): Trace[78393701]: [7.002264235s] [7.002264235s] END E0629 00:49:19.642156 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:19.642234 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:19.643780 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:19.643965 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:19.645138 1 trace.go:236] Trace[1759975167]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:87403be8-1d6a-470d-8c01-dc68c58c7144,client:10.0.0.154,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:14.643) (total time: 5001ms): Trace[1759975167]: [5.001805835s] [5.001805835s] END E0629 00:49:19.645226 1 timeout.go:142] post-timeout activity - time-elapsed: 3.043451ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0629 00:49:19.874183 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:19.874289 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:19.875434 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:19.875475 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:19.875560 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:19.877199 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:19.877255 1 trace.go:236] Trace[1638699556]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f1091e0d-a1b0-4b0c-9555-fb52bae7f2d0,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:16.876) (total time: 3000ms): Trace[1638699556]: [3.000650752s] [3.000650752s] END E0629 00:49:19.877333 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:19.877356 1 timeout.go:142] post-timeout activity - time-elapsed: 3.204795ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0629 00:49:19.877381 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:19.877381 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:19.878403 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:19.878444 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:19.878479 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:19.878478 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:19.879633 1 trace.go:236] Trace[841790983]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a7ec47fc-2b42-4c9f-a707-ac6374e13fbe,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:16.877) (total time: 3002ms): Trace[841790983]: [3.002072381s] [3.002072381s] END E0629 00:49:19.879684 1 timeout.go:142] post-timeout activity - time-elapsed: 4.266865ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0629 00:49:19.879686 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0629 00:49:19.879713 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:19.880831 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:19.880888 1 trace.go:236] Trace[1991910356]: "Get" accept:application/json, */*,audit-id:ec054798-0cd5-4efd-9ff5-50407c72d35f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.876) (total time: 10003ms): Trace[1991910356]: [10.003950587s] [10.003950587s] END I0629 00:49:19.880904 1 trace.go:236] Trace[317005653]: "Get" accept:application/json, */*,audit-id:97c79594-92a6-4bb6-939b-14c11da9a28d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.877) (total time: 10003ms): Trace[317005653]: [10.003802915s] [10.003802915s] END E0629 00:49:19.881047 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:19.881051 1 timeout.go:142] post-timeout activity - time-elapsed: 3.680505ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0629 00:49:19.881172 1 timeout.go:142] post-timeout activity - time-elapsed: 3.787237ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0629 00:49:19.882133 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:19.882425 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:19.883391 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:19.883616 1 trace.go:236] Trace[743491783]: "Get" accept:application/json, */*,audit-id:afa6a731-01a6-4edd-ad37-239569cd4f47,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:16.883) (total time: 3000ms): Trace[743491783]: [3.000218173s] [3.000218173s] END E0629 00:49:19.883751 1 timeout.go:142] post-timeout activity - time-elapsed: 2.674424ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0629 00:49:20.572683 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:20.572848 1 trace.go:236] Trace[221918967]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a76a6e1d-051b-4b29-82ee-8ac0a215a701,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-Jun-2026 00:49:13.569) (total time: 7002ms): Trace[221918967]: ["GuaranteedUpdate etcd3" audit-id:a76a6e1d-051b-4b29-82ee-8ac0a215a701,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (00:49:13.570) Trace[221918967]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (00:49:20.572)] Trace[221918967]: [7.002875776s] [7.002875776s] END E0629 00:49:21.476272 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:21.476415 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:21.477487 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:21.477575 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:21.478635 1 trace.go:236] Trace[834836158]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:23f225eb-5059-463e-8451-e0f71aa04a1f,client:10.0.0.146,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:16.481) (total time: 4996ms): Trace[834836158]: [4.996625131s] [4.996625131s] END E0629 00:49:21.478797 1 timeout.go:142] post-timeout activity - time-elapsed: 2.550112ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0629 00:49:21.593475 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:21.593552 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:21.595255 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:21.595330 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:21.596355 1 trace.go:236] Trace[1706831638]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:07d671ce-6455-4c5e-8d3b-97bbbd2cca81,client:10.0.0.146,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.712) (total time: 11883ms): Trace[1706831638]: [11.883883079s] [11.883883079s] END E0629 00:49:21.596457 1 timeout.go:142] post-timeout activity - time-elapsed: 3.061292ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0629 00:49:21.637721 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:21.637974 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:21.639687 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:21.639852 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:21.640779 1 trace.go:236] Trace[1545825547]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:988aed30-3e5f-43c1-9127-c7a23a894f86,client:10.0.0.200,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:16.638) (total time: 5001ms): Trace[1545825547]: [5.001743504s] [5.001743504s] END E0629 00:49:21.641067 1 timeout.go:142] post-timeout activity - time-elapsed: 3.539031ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0629 00:49:21.647288 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:21.647412 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:21.648743 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:21.648840 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:21.650107 1 trace.go:236] Trace[1094963265]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b7442bbe-acd7-464c-82c7-13988776fbc8,client:10.0.0.211,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:16.649) (total time: 5000ms): Trace[1094963265]: [5.000893917s] [5.000893917s] END E0629 00:49:21.650294 1 timeout.go:142] post-timeout activity - time-elapsed: 2.934639ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0629 00:49:21.754368 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:21.754569 1 trace.go:236] Trace[45092084]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a371d116-9f4b-4b5d-829d-c4fcd61d2b4c,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Jun-2026 00:49:13.909) (total time: 7845ms): Trace[45092084]: ["Create etcd3" audit-id:a371d116-9f4b-4b5d-829d-c4fcd61d2b4c,key:/events/kube-system/kube-apiserver-instance.18bd66e34ad8dee5,type:*core.Event,resource:events 7844ms (00:49:13.909)] Trace[45092084]: [7.84530461s] [7.84530461s] END I0629 00:49:22.139233 1 metrics.go:285] "Failed to get storage metrics" storage_cluster_id="etcd-0" err="context deadline exceeded" E0629 00:49:23.107194 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.107400 1 trace.go:236] Trace[812376082]: "Update" accept:application/json, */*,audit-id:284e7c30-86ab-49ed-9482-aa2d5478d5b2,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (29-Jun-2026 00:49:16.103) (total time: 7003ms): Trace[812376082]: ["GuaranteedUpdate etcd3" audit-id:284e7c30-86ab-49ed-9482-aa2d5478d5b2,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (00:49:16.104) Trace[812376082]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (00:49:23.107)] Trace[812376082]: [7.003621522s] [7.003621522s] END E0629 00:49:23.691151 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691171 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691180 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691197 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691229 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691238 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691249 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691245 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691290 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691306 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691316 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.691325 1 trace.go:236] Trace[25241830]: "Get" accept:application/json, */*,audit-id:58379897-dacb-4a7c-bd55-73699a2a30bd,client:10.0.0.157,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.311) (total time: 13379ms): Trace[25241830]: [13.379508045s] [13.379508045s] END E0629 00:49:23.691349 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691353 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691389 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691451 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.691482 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.692418 1 trace.go:236] Trace[299466927]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (29-Jun-2026 00:49:11.782) (total time: 11910ms): Trace[299466927]: [11.910044757s] [11.910044757s] END E0629 00:49:23.692454 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0629 00:49:23.692463 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.692467 1 trace.go:236] Trace[486592978]: "Get" accept:application/json, */*,audit-id:eabd5376-12fc-4e14-8069-88bec61e1c30,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-metadata,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.953) (total time: 12739ms): Trace[486592978]: [12.739380275s] [12.739380275s] END E0629 00:49:23.692486 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.692504 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.692529 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.692556 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.692586 1 trace.go:236] Trace[1160227587]: "Get" accept:application/json, */*,audit-id:1386a4ec-630a-4178-b86d-4b7fb112f2d7,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.688) (total time: 14003ms): Trace[1160227587]: [14.003712143s] [14.003712143s] END I0629 00:49:23.692595 1 trace.go:236] Trace[406816806]: "Get" accept:application/json, */*,audit-id:a878b565-b032-40e0-8612-6a0fa82a4c3e,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.956) (total time: 12736ms): Trace[406816806]: [12.736396184s] [12.736396184s] END I0629 00:49:23.692602 1 trace.go:236] Trace[1794145988]: "Get" accept:application/json, */*,audit-id:a94d71af-acc1-4d4d-8606-865d76559e05,client:10.0.0.199,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:11.450) (total time: 12241ms): Trace[1794145988]: [12.241569254s] [12.241569254s] END I0629 00:49:23.692630 1 trace.go:236] Trace[1919502508]: "Get" accept:application/json, */*,audit-id:b0208c94-73a9-4ce4-8257-01ab664e17fc,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-skfw8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.968) (total time: 13724ms): Trace[1919502508]: [13.724124306s] [13.724124306s] END I0629 00:49:23.692751 1 trace.go:236] Trace[29516358]: "Get" accept:application/json, */*,audit-id:ac9d8df6-4620-47ed-a3a4-cb97e5b51a6b,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-compute-default-7fch8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:11.076) (total time: 12615ms): Trace[29516358]: [12.615831516s] [12.615831516s] END I0629 00:49:23.692759 1 trace.go:236] Trace[262643056]: "Get" accept:application/json, */*,audit-id:50c7702d-232e-4dba-a108-5a4c473bf3d8,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/libvirt-libvirt-default-2hfbm,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.011) (total time: 13681ms): Trace[262643056]: [13.681634366s] [13.681634366s] END I0629 00:49:23.692774 1 trace.go:236] Trace[537346084]: "Get" accept:application/json, */*,audit-id:4c9ec63b-ac88-46ff-8c63-45f2139a1387,client:10.0.0.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.785) (total time: 13906ms): Trace[537346084]: [13.906798212s] [13.906798212s] END E0629 00:49:23.692775 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.692612 1 trace.go:236] Trace[1383832282]: "Get" accept:application/json, */*,audit-id:e444694f-eb81-447c-9d1d-43f0fb364bc8,client:10.0.0.199,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:11.451) (total time: 12241ms): Trace[1383832282]: [12.241394701s] [12.241394701s] END E0629 00:49:23.692843 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.692613 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.692888 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:23.692896 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.692904 1 trace.go:236] Trace[651348920]: "Get" accept:application/json, */*,audit-id:4d499576-8915-4dc3-a03d-5a9e0fa76333,client:10.0.0.125,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.807) (total time: 13885ms): Trace[651348920]: [13.885081272s] [13.885081272s] END I0629 00:49:23.692958 1 trace.go:236] Trace[1611249978]: "Get" accept:application/json, */*,audit-id:9f5da61c-573a-4dd6-a32e-8443dc40eefa,client:10.0.0.125,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.808) (total time: 13884ms): Trace[1611249978]: [13.88493063s] [13.88493063s] END I0629 00:49:23.692971 1 trace.go:236] Trace[1343956138]: "Get" accept:application/json, */*,audit-id:57480715-8a74-49d7-9506-5dd4f712734e,client:199.204.45.246,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.955) (total time: 12736ms): Trace[1343956138]: [12.736974757s] [12.736974757s] END E0629 00:49:23.692612 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.693000 1 trace.go:236] Trace[1042544543]: "Get" accept:application/json, */*,audit-id:e46007c7-323b-4988-bd8f-f3a0ab417af2,client:199.204.45.246,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.953) (total time: 12739ms): Trace[1042544543]: [12.7395819s] [12.7395819s] END E0629 00:49:23.693007 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:23.693034 1 trace.go:236] Trace[1388678237]: "Get" accept:application/json, */*,audit-id:e3409fb1-f6ee-4fe5-9cf2-e222466e0b92,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.942) (total time: 13750ms): Trace[1388678237]: [13.750235875s] [13.750235875s] END I0629 00:49:23.693040 1 trace.go:236] Trace[435641130]: "Get" accept:application/json, */*,audit-id:3c78b5d6-030f-4999-ad27-e228d503df48,client:10.0.0.125,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.808) (total time: 13884ms): Trace[435641130]: [13.884876399s] [13.884876399s] END I0629 00:49:23.694128 1 trace.go:236] Trace[1615528077]: "Get" accept:application/json, */*,audit-id:1f2bbc44-66c8-44d3-b1df-525f5109ea3b,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.950) (total time: 13743ms): Trace[1615528077]: [13.743898107s] [13.743898107s] END I0629 00:49:23.694185 1 trace.go:236] Trace[1464829927]: "Get" accept:application/json, */*,audit-id:817da833-5e39-4499-afe2-bca008a91811,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.942) (total time: 13751ms): Trace[1464829927]: [13.751163624s] [13.751163624s] END I0629 00:49:23.694400 1 trace.go:236] Trace[1705469724]: "Get" accept:application/json, */*,audit-id:7d22c197-5d7f-4b91-9354-82628fd92d6e,client:10.0.0.156,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.781) (total time: 13912ms): Trace[1705469724]: [13.912490456s] [13.912490456s] END I0629 00:49:23.694460 1 trace.go:236] Trace[352324807]: "Get" accept:application/json, */*,audit-id:70336e29-017c-4ef3-b1af-2a112dc76e25,client:10.0.0.199,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:11.454) (total time: 12239ms): Trace[352324807]: [12.239520103s] [12.239520103s] END I0629 00:49:23.694495 1 trace.go:236] Trace[725921847]: "Get" accept:application/json, */*,audit-id:c67aec09-94fd-4371-9a39-538d605adf77,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:10.953) (total time: 12741ms): Trace[725921847]: [12.7411211s] [12.7411211s] END I0629 00:49:23.694800 1 trace.go:236] Trace[368003356]: "Get" accept:application/json, */*,audit-id:23ed8b44-bf2b-4fc8-910b-11f756f7d28a,client:10.0.0.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.783) (total time: 13911ms): Trace[368003356]: [13.911476546s] [13.911476546s] END I0629 00:49:23.694834 1 trace.go:236] Trace[608963312]: "Get" accept:application/json, */*,audit-id:efe6d64c-b805-46b2-aab1-0ca092d3d014,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-compute-default-7fch8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:11.064) (total time: 12629ms): Trace[608963312]: [12.629944961s] [12.629944961s] END I0629 00:49:23.694935 1 trace.go:236] Trace[216975870]: "Get" accept:application/json, */*,audit-id:1c7e5bb5-591f-4f36-bf2c-d215970662c5,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.689) (total time: 14005ms): Trace[216975870]: [14.005790484s] [14.005790484s] END I0629 00:49:23.694944 1 trace.go:236] Trace[829342658]: "Get" accept:application/json, */*,audit-id:145c0a87-36d9-4150-a4fd-6cb648c1baa0,client:10.0.0.125,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-fnls8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.900) (total time: 13794ms): Trace[829342658]: [13.794548471s] [13.794548471s] END I0629 00:49:23.695038 1 trace.go:236] Trace[2082788601]: "Get" accept:application/json, */*,audit-id:66d16b49-8544-4f9e-bb90-7d437e6a386b,client:10.0.0.191,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.904) (total time: 13790ms): Trace[2082788601]: [13.790207902s] [13.790207902s] END I0629 00:49:23.695139 1 trace.go:236] Trace[1588033237]: "Get" accept:application/json, */*,audit-id:dcadd7f9-10b5-483c-886a-a118449c7bd4,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.693) (total time: 14001ms): Trace[1588033237]: [14.001601629s] [14.001601629s] END I0629 00:49:23.695290 1 trace.go:236] Trace[1181086608]: "Get" accept:application/json, */*,audit-id:071bd380-385b-4c31-b7d1-f79a8be8b554,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:09.942) (total time: 13752ms): Trace[1181086608]: [13.752855457s] [13.752855457s] END E0629 00:49:24.159098 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:24.159389 1 trace.go:236] Trace[791047024]: "Update" accept:application/json, */*,audit-id:28458025-d676-495a-ab86-dfbbca355969,client:10.0.0.68,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:49:17.155) (total time: 7003ms): Trace[791047024]: ["GuaranteedUpdate etcd3" audit-id:28458025-d676-495a-ab86-dfbbca355969,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (00:49:17.156) Trace[791047024]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (00:49:24.159)] Trace[791047024]: [7.003261085s] [7.003261085s] END E0629 00:49:24.200257 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:24.200485 1 trace.go:236] Trace[563010104]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ef37a3cd-2f9f-4122-b3d0-38b781843608,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:17.197) (total time: 7002ms): Trace[563010104]: ["GuaranteedUpdate etcd3" audit-id:ef37a3cd-2f9f-4122-b3d0-38b781843608,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (00:49:17.197) Trace[563010104]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (00:49:24.200)] Trace[563010104]: [7.002838626s] [7.002838626s] END E0629 00:49:24.858587 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:24.858754 1 trace.go:236] Trace[1856741528]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:90b84cdc-a9d6-4daa-8d97-ef838ffe6dc1,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:17.855) (total time: 7002ms): Trace[1856741528]: ["GuaranteedUpdate etcd3" audit-id:90b84cdc-a9d6-4daa-8d97-ef838ffe6dc1,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (00:49:17.856) Trace[1856741528]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (00:49:24.858)] Trace[1856741528]: [7.002889108s] [7.002889108s] END E0629 00:49:24.859156 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0629 00:49:24.874736 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:24.874778 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:24.875379 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 548.852µs, panicked: false, err: context canceled, panic-reason: E0629 00:49:24.876003 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:24.877248 1 trace.go:236] Trace[2006375145]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a8c2bb4b-18cb-4163-ab4f-12b18f35bf6e,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Jun-2026 00:49:19.874) (total time: 5002ms): Trace[2006375145]: ["GuaranteedUpdate etcd3" audit-id:a8c2bb4b-18cb-4163-ab4f-12b18f35bf6e,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (00:49:19.875) Trace[2006375145]: ---"Txn call failed" err:context canceled 4998ms (00:49:24.874)] Trace[2006375145]: [5.002190213s] [5.002190213s] END E0629 00:49:24.877376 1 timeout.go:142] post-timeout activity - time-elapsed: 2.725485ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0629 00:49:24.881764 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:24.881791 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:24.881870 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.591µs, panicked: false, err: context deadline exceeded, panic-reason: E0629 00:49:24.883562 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:24.883639 1 trace.go:236] Trace[550836574]: "Update" accept:application/json, */*,audit-id:4ea1f4ea-7776-44ec-8395-0ec42d1c992d,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Jun-2026 00:49:19.881) (total time: 5001ms): Trace[550836574]: ["GuaranteedUpdate etcd3" audit-id:4ea1f4ea-7776-44ec-8395-0ec42d1c992d,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (00:49:19.882) Trace[550836574]: ---"Txn call failed" err:context deadline exceeded 4998ms (00:49:24.881)] Trace[550836574]: [5.001588752s] [5.001588752s] END E0629 00:49:24.883742 1 timeout.go:142] post-timeout activity - time-elapsed: 1.98542ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0629 00:49:26.881619 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:26.881747 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:26.882450 1 trace.go:236] Trace[1993326408]: "Update" accept:application/json, */*,audit-id:a8744d96-d10c-4ff6-a97a-a4b409fc28b6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Jun-2026 00:49:19.878) (total time: 7004ms): Trace[1993326408]: ["GuaranteedUpdate etcd3" audit-id:a8744d96-d10c-4ff6-a97a-a4b409fc28b6,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (00:49:19.878) Trace[1993326408]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (00:49:26.881)] Trace[1993326408]: [7.004230664s] [7.004230664s] END I0629 00:49:26.882872 1 trace.go:236] Trace[1575781042]: "Update" accept:application/json, */*,audit-id:beee6348-0350-41d1-bce1-58682c5c94c1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Jun-2026 00:49:19.878) (total time: 7004ms): Trace[1575781042]: ["GuaranteedUpdate etcd3" audit-id:beee6348-0350-41d1-bce1-58682c5c94c1,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (00:49:19.878) Trace[1575781042]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (00:49:26.881)] Trace[1575781042]: [7.004475719s] [7.004475719s] END E0629 00:49:28.571437 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:28.571569 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:28.572932 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:28.572978 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:28.574055 1 trace.go:236] Trace[467174103]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a2c06443-7a58-4d43-b423-2382eefefffd,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (29-Jun-2026 00:49:20.574) (total time: 7999ms): Trace[467174103]: [7.999439618s] [7.999439618s] END E0629 00:49:28.574158 1 timeout.go:142] post-timeout activity - time-elapsed: 2.785206ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: E0629 00:49:28.757150 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:28.757300 1 trace.go:236] Trace[654574606]: "Create" accept:application/json, */*,audit-id:b46091e5-be92-4172-bd55-8ad61a6d1f67,client:10.0.0.154,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (29-Jun-2026 00:49:19.645) (total time: 9112ms): Trace[654574606]: ["Create etcd3" audit-id:b46091e5-be92-4172-bd55-8ad61a6d1f67,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18bd66e4a0a4cdec,type:*core.Event,resource:events 9111ms (00:49:19.645)] Trace[654574606]: [9.112209227s] [9.112209227s] END E0629 00:49:30.692949 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:30.692961 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:30.693119 1 trace.go:236] Trace[574429028]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8d484367-8cdf-4651-8c36-cdc4408590e4,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bd66dc393a7556,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Jun-2026 00:49:21.757) (total time: 8935ms): Trace[574429028]: ["GuaranteedUpdate etcd3" audit-id:8d484367-8cdf-4651-8c36-cdc4408590e4,key:/events/kube-system/kube-apiserver-instance.18bd66dc393a7556,type:*core.Event,resource:events 8935ms (00:49:21.757)] Trace[574429028]: [8.935654096s] [8.935654096s] END E0629 00:49:30.693172 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:30.694781 1 trace.go:236] Trace[1209630398]: "Get" accept:application/json, */*,audit-id:b1c476b3-dd59-4cab-a994-d5fefd85fc76,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:18.693) (total time: 12001ms): Trace[1209630398]: [12.001700682s] [12.001700682s] END I0629 00:49:30.694822 1 trace.go:236] Trace[1111039414]: "Get" accept:application/json, */*,audit-id:4180fd95-a965-458d-a0b3-a5fa2129b8c8,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:GET (29-Jun-2026 00:49:23.109) (total time: 7585ms): Trace[1111039414]: [7.585418022s] [7.585418022s] END E0629 00:49:31.206335 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:31.206572 1 trace.go:236] Trace[924395788]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7fb552a9-85d5-4c5f-952f-3964bcec2555,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:24.202) (total time: 7003ms): Trace[924395788]: ["GuaranteedUpdate etcd3" audit-id:7fb552a9-85d5-4c5f-952f-3964bcec2555,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (00:49:24.202) Trace[924395788]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (00:49:31.206)] Trace[924395788]: [7.003908009s] [7.003908009s] END E0629 00:49:31.863171 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:31.863346 1 trace.go:236] Trace[680362585]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b8c5d050-f7da-4bb0-9e37-35aa9647be64,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:24.860) (total time: 7003ms): Trace[680362585]: ["GuaranteedUpdate etcd3" audit-id:b8c5d050-f7da-4bb0-9e37-35aa9647be64,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (00:49:24.860) Trace[680362585]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (00:49:31.863)] Trace[680362585]: [7.003193353s] [7.003193353s] END E0629 00:49:31.863915 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0629 00:49:35.575982 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:35.576849 1 trace.go:236] Trace[2073865194]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6a13d59e-d45c-46a4-9cad-2128cdcdb90f,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-Jun-2026 00:49:28.572) (total time: 7003ms): Trace[2073865194]: ["GuaranteedUpdate etcd3" audit-id:6a13d59e-d45c-46a4-9cad-2128cdcdb90f,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (00:49:28.573) Trace[2073865194]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (00:49:35.575)] Trace[2073865194]: [7.003320956s] [7.003320956s] END E0629 00:49:37.692596 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.692751 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.692790 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:37.692803 1 trace.go:236] Trace[1421675941]: "Get" accept:application/json, */*,audit-id:bdc08a24-e01a-4324-a867-27edc71de57e,client:10.0.0.125,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11993ms): Trace[1421675941]: [11.993762791s] [11.993762791s] END E0629 00:49:37.692853 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:37.692926 1 trace.go:236] Trace[117974814]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (29-Jun-2026 00:49:23.692) (total time: 14000ms): Trace[117974814]: [14.000240003s] [14.000240003s] END E0629 00:49:37.692941 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0629 00:49:37.693061 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693107 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693159 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693168 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693165 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693219 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693303 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693329 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693387 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693418 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693445 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693465 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693485 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693494 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693532 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693541 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693556 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693585 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693590 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693595 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693617 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693615 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693617 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693654 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693654 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693659 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0629 00:49:37.693742 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:37.693815 1 trace.go:236] Trace[280354498]: "Get" accept:application/json, */*,audit-id:53d013d9-9c04-45f6-9070-38f6726c5b8a,client:10.0.0.157,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.696) (total time: 11997ms): Trace[280354498]: [11.997577798s] [11.997577798s] END I0629 00:49:37.694187 1 trace.go:236] Trace[1138335696]: "Get" accept:application/json, */*,audit-id:3ea45ede-b770-48b8-8dcb-669c6103b276,client:10.0.0.191,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.699) (total time: 11994ms): Trace[1138335696]: [11.994404405s] [11.994404405s] END I0629 00:49:37.694231 1 trace.go:236] Trace[1456542070]: "List" accept:application/json, */*,audit-id:7466b11c-cbe4-4ea3-aeab-78ca5bc4761d,client:10.0.0.17,protocol:HTTP/2.0,resource:deployments,scope:namespace,url:/apis/apps/v1/namespaces/openstack/deployments,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (29-Jun-2026 00:49:23.733) (total time: 13960ms): Trace[1456542070]: ["List(recursive=true) etcd3" audit-id:7466b11c-cbe4-4ea3-aeab-78ca5bc4761d,key:/deployments/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 13960ms (00:49:23.734)] Trace[1456542070]: [13.960244144s] [13.960244144s] END I0629 00:49:37.694250 1 trace.go:236] Trace[72699718]: "Get" accept:application/json, */*,audit-id:4d2ceb56-1c39-475c-992c-6d24cb7cf524,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-compute-default-7fch8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.700) (total time: 11993ms): Trace[72699718]: [11.993530777s] [11.993530777s] END I0629 00:49:37.694316 1 trace.go:236] Trace[1588898078]: "Get" accept:application/json, */*,audit-id:e7bf2483-be51-4127-9109-b69751c3f673,client:10.0.0.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.696) (total time: 11998ms): Trace[1588898078]: [11.998128651s] [11.998128651s] END I0629 00:49:37.694475 1 trace.go:236] Trace[2113059349]: "Get" accept:application/json, */*,audit-id:fbf18f35-69ce-44bd-918b-760825171943,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-compute-default-7fch8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.700) (total time: 11994ms): Trace[2113059349]: [11.994268992s] [11.994268992s] END I0629 00:49:37.694549 1 trace.go:236] Trace[2132788381]: "Get" accept:application/json, */*,audit-id:706167c2-3c9f-4fd1-8e7d-b4e7f3be89b2,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11995ms): Trace[2132788381]: [11.995865395s] [11.995865395s] END I0629 00:49:37.694316 1 trace.go:236] Trace[1248864220]: "Get" accept:application/json, */*,audit-id:02273496-451e-47ce-be61-43d877176d38,client:10.0.0.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.699) (total time: 11994ms): Trace[1248864220]: [11.994895915s] [11.994895915s] END I0629 00:49:37.694673 1 trace.go:236] Trace[929390130]: "Get" accept:application/json, */*,audit-id:0d42a236-0dbf-4e97-bbab-16fc30c9d533,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/libvirt-libvirt-default-2hfbm,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.695) (total time: 11998ms): Trace[929390130]: [11.998923167s] [11.998923167s] END I0629 00:49:37.694779 1 trace.go:236] Trace[2124884488]: "Get" accept:application/json, */*,audit-id:dbc4b746-a706-4a33-ad29-5c83265f8f4f,client:10.0.0.199,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.700) (total time: 11994ms): Trace[2124884488]: [11.994117229s] [11.994117229s] END I0629 00:49:37.694844 1 trace.go:236] Trace[687000203]: "Get" accept:application/json, */*,audit-id:d52a02c5-1b5c-4a92-8f77-f0e4fcd1fa74,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.700) (total time: 11994ms): Trace[687000203]: [11.994384094s] [11.994384094s] END I0629 00:49:37.694875 1 trace.go:236] Trace[470643134]: "Get" accept:application/json, */*,audit-id:3648239a-f8b7-4aa2-9b6d-8850203aa0b3,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-skfw8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.696) (total time: 11997ms): Trace[470643134]: [11.997937746s] [11.997937746s] END I0629 00:49:37.694922 1 trace.go:236] Trace[379518336]: "Get" accept:application/json, */*,audit-id:7c22e4ab-fda5-4d41-8f19-4bcd1cc6762b,client:10.0.0.125,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.699) (total time: 11995ms): Trace[379518336]: [11.995515457s] [11.995515457s] END I0629 00:49:37.695030 1 trace.go:236] Trace[367465961]: "Get" accept:application/json, */*,audit-id:3d52a3c3-7667-4eb3-a84c-1b1f8d99011e,client:10.0.0.125,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11996ms): Trace[367465961]: [11.996566499s] [11.996566499s] END I0629 00:49:37.695080 1 trace.go:236] Trace[1731674458]: "Get" accept:application/json, */*,audit-id:2298a1f2-24b6-49c0-b032-4c353156c914,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.699) (total time: 11995ms): Trace[1731674458]: [11.99566016s] [11.99566016s] END I0629 00:49:37.695200 1 trace.go:236] Trace[2851318]: "Get" accept:application/json, */*,audit-id:5f3c2c9c-30ec-49c2-bbee-11da7698e442,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.697) (total time: 11997ms): Trace[2851318]: [11.997779723s] [11.997779723s] END I0629 00:49:37.695229 1 trace.go:236] Trace[1798778099]: "Get" accept:application/json, */*,audit-id:5b3e9d1f-199f-49ba-a323-7c38cb22a40f,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.696) (total time: 11998ms): Trace[1798778099]: [11.998762973s] [11.998762973s] END I0629 00:49:37.695234 1 trace.go:236] Trace[142200855]: "Get" accept:application/json, */*,audit-id:efed07fe-0073-4eee-8308-2f8d3d88b0b6,client:199.204.45.246,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.697) (total time: 11997ms): Trace[142200855]: [11.99760124s] [11.99760124s] END I0629 00:49:37.695275 1 trace.go:236] Trace[1636464571]: "Get" accept:application/json, */*,audit-id:1f1ea82b-1318-4fa4-9996-04efbf97ebf3,client:10.0.0.125,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-fnls8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11997ms): Trace[1636464571]: [11.997062859s] [11.997062859s] END I0629 00:49:37.695281 1 trace.go:236] Trace[1836257706]: "Get" accept:application/json, */*,audit-id:bcc771c8-fae0-4455-b5c6-c83a8958b054,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.700) (total time: 11994ms): Trace[1836257706]: [11.994932936s] [11.994932936s] END I0629 00:49:37.695283 1 trace.go:236] Trace[769040236]: "Get" accept:application/json, */*,audit-id:419800fd-42ae-4d9e-989a-057835dce418,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11996ms): Trace[769040236]: [11.996845415s] [11.996845415s] END I0629 00:49:37.695381 1 trace.go:236] Trace[536656007]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7e5360aa-e97a-4903-8ebc-84c1928e722a,client:199.204.45.246,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (29-Jun-2026 00:49:24.658) (total time: 13036ms): Trace[536656007]: [13.036361224s] [13.036361224s] END I0629 00:49:37.695402 1 trace.go:236] Trace[780901732]: "Get" accept:application/json, */*,audit-id:446cb065-d819-45d5-aeb3-417ad6ed125c,client:10.0.0.156,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.699) (total time: 11995ms): Trace[780901732]: [11.995580688s] [11.995580688s] END I0629 00:49:37.695412 1 trace.go:236] Trace[952480398]: "Get" accept:application/json, */*,audit-id:2dabcca3-7a06-4c48-97cf-413767bcdf84,client:10.0.0.199,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11996ms): Trace[952480398]: [11.996836344s] [11.996836344s] END I0629 00:49:37.695402 1 trace.go:236] Trace[1667795311]: "Get" accept:application/json, */*,audit-id:4a10fba4-fe7d-4f3c-9079-cab6d04d86f3,client:199.204.45.246,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.697) (total time: 11997ms): Trace[1667795311]: [11.997529358s] [11.997529358s] END I0629 00:49:37.695466 1 trace.go:236] Trace[803220661]: "Get" accept:application/json, */*,audit-id:dcdfc411-68b8-47f8-afea-89852ee71382,client:10.0.0.68,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:24.161) (total time: 13534ms): Trace[803220661]: [13.534040381s] [13.534040381s] END I0629 00:49:37.695494 1 trace.go:236] Trace[629982538]: "Get" accept:application/json, */*,audit-id:20374821-4bf8-40d5-a767-0f68ff24150e,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-metadata,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11996ms): Trace[629982538]: [11.996702701s] [11.996702701s] END I0629 00:49:37.695506 1 trace.go:236] Trace[837874085]: "Get" accept:application/json, */*,audit-id:b2f2f3ab-bf63-4b91-8faf-1069dfd13280,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.699) (total time: 11995ms): Trace[837874085]: [11.99564831s] [11.99564831s] END I0629 00:49:37.695543 1 trace.go:236] Trace[767784781]: "Get" accept:application/json, */*,audit-id:a0b236ae-fdc4-416f-945b-3f1fdcec43c8,client:10.0.0.199,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.698) (total time: 11997ms): Trace[767784781]: [11.997450847s] [11.997450847s] END I0629 00:49:37.695596 1 trace.go:236] Trace[1867920255]: "Get" accept:application/json, */*,audit-id:a97eaa98-533d-43fe-9f4b-cd5a03cfd8ce,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:25.700) (total time: 11995ms): Trace[1867920255]: [11.995332873s] [11.995332873s] END I0629 00:49:38.136717 1 trace.go:236] Trace[994126033]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:06f85cb4-b816-422c-9c08-52eaf813a7fe,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:31.208) (total time: 6928ms): Trace[994126033]: ["GuaranteedUpdate etcd3" audit-id:06f85cb4-b816-422c-9c08-52eaf813a7fe,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6928ms (00:49:31.208) Trace[994126033]: ---"Txn call completed" 6926ms (00:49:38.136)] Trace[994126033]: [6.928175986s] [6.928175986s] END I0629 00:49:38.136867 1 trace.go:236] Trace[1941123593]: "Get" accept:application/json, */*,audit-id:57804b4a-fe41-4aaf-a4de-dac4e90cfdc7,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:32.698) (total time: 5438ms): Trace[1941123593]: [5.438263386s] [5.438263386s] END I0629 00:49:38.137860 1 trace.go:236] Trace[1248625540]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aac3fe7c-3178-49f9-aa57-746118220d7d,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (29-Jun-2026 00:49:35.580) (total time: 2557ms): Trace[1248625540]: ---"About to write a response" 2557ms (00:49:38.137) Trace[1248625540]: [2.557229312s] [2.557229312s] END I0629 00:49:38.137886 1 trace.go:236] Trace[372264029]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4d2ab696-8073-4584-8d7c-15957382b7a8,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:31.865) (total time: 6272ms): Trace[372264029]: ["GuaranteedUpdate etcd3" audit-id:4d2ab696-8073-4584-8d7c-15957382b7a8,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 6272ms (00:49:31.865) Trace[372264029]: ---"Txn call completed" 6271ms (00:49:38.137)] Trace[372264029]: [6.272736597s] [6.272736597s] END E0629 00:49:38.139792 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0629 00:49:38.153844 1 trace.go:236] Trace[2035886208]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c6e11894-aeef-4cdc-ad72-bfde1895be31,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bd66dc393a7556,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Jun-2026 00:49:30.695) (total time: 7457ms): Trace[2035886208]: ["GuaranteedUpdate etcd3" audit-id:c6e11894-aeef-4cdc-ad72-bfde1895be31,key:/events/kube-system/kube-apiserver-instance.18bd66dc393a7556,type:*core.Event,resource:events 7457ms (00:49:30.696) Trace[2035886208]: ---"initial value restored" 7440ms (00:49:38.136)] Trace[2035886208]: ---"Object stored in database" 15ms (00:49:38.152) Trace[2035886208]: [7.457857562s] [7.457857562s] END E0629 00:49:48.579695 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0629 00:49:48.579793 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:48.581490 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:48.581544 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:48.582695 1 trace.go:236] Trace[1224758526]: "Get" accept:application/json, */*,audit-id:ed1e9dd0-f7f4-4423-8f65-96005ad5fc84,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:43.579) (total time: 5002ms): Trace[1224758526]: [5.002720343s] [5.002720343s] END E0629 00:49:48.582896 1 timeout.go:142] post-timeout activity - time-elapsed: 3.071142ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0629 00:49:49.581841 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0629 00:49:49.581964 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:49.583343 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:49.583449 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:49.584521 1 trace.go:236] Trace[1807056627]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6b12e824-e6d0-40b1-a1ce-907220236898,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:44.582) (total time: 5002ms): Trace[1807056627]: [5.002294735s] [5.002294735s] END E0629 00:49:49.584676 1 timeout.go:142] post-timeout activity - time-elapsed: 2.560142ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0629 00:49:50.052823 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0629 00:49:50.053067 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:50.054688 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:50.054756 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:50.055986 1 trace.go:236] Trace[1518100693]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4a3f6b7f-90de-416b-b356-6330c7c91661,client:10.0.0.146,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:45.053) (total time: 5002ms): Trace[1518100693]: [5.002845297s] [5.002845297s] END E0629 00:49:50.056189 1 timeout.go:142] post-timeout activity - time-elapsed: 3.154574ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0629 00:49:50.369615 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:50.369869 1 trace.go:236] Trace[642782066]: "Update" accept:application/json, */*,audit-id:887630db-4269-4e99-a65f-a257022d9435,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Jun-2026 00:49:43.367) (total time: 7002ms): Trace[642782066]: ["GuaranteedUpdate etcd3" audit-id:887630db-4269-4e99-a65f-a257022d9435,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (00:49:43.367) Trace[642782066]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (00:49:50.369)] Trace[642782066]: [7.002756292s] [7.002756292s] END E0629 00:49:50.372373 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0629 00:49:50.372604 1 trace.go:236] Trace[1387931767]: "Update" accept:application/json, */*,audit-id:dfd10411-0f0b-4006-baf3-16a52c04958c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Jun-2026 00:49:43.368) (total time: 7003ms): Trace[1387931767]: ["GuaranteedUpdate etcd3" audit-id:dfd10411-0f0b-4006-baf3-16a52c04958c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (00:49:43.368) Trace[1387931767]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (00:49:50.371)] Trace[1387931767]: [7.003878205s] [7.003878205s] END E0629 00:49:50.450236 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0629 00:49:50.450427 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0629 00:49:50.451363 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0629 00:49:50.451670 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0629 00:49:50.452513 1 trace.go:236] Trace[578087516]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:beffd7a5-3a59-4c23-b3a4-ed562640c3a6,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:45.450) (total time: 5001ms): Trace[578087516]: [5.001693193s] [5.001693193s] END E0629 00:49:50.452677 1 timeout.go:142] post-timeout activity - time-elapsed: 2.422719ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0629 00:49:50.935213 1 trace.go:236] Trace[2142507653]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d1e143f8-5290-42e9-8036-2d39fb749a2f,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-Jun-2026 00:49:45.673) (total time: 5261ms): Trace[2142507653]: ["GuaranteedUpdate etcd3" audit-id:d1e143f8-5290-42e9-8036-2d39fb749a2f,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 5261ms (00:49:45.674) Trace[2142507653]: ---"Txn call completed" 5260ms (00:49:50.934)] Trace[2142507653]: [5.261129782s] [5.261129782s] END I0629 00:49:50.936406 1 trace.go:236] Trace[1035606559]: "Get" accept:application/json, */*,audit-id:ae333b6b-52a9-452f-b074-eb495ce313c4,client:10.0.0.156,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.716) (total time: 7219ms): Trace[1035606559]: ---"About to write a response" 7219ms (00:49:50.936) Trace[1035606559]: [7.21956557s] [7.21956557s] END I0629 00:49:50.936577 1 trace.go:236] Trace[1668221540]: "Get" accept:application/json, */*,audit-id:fbcbf723-25dc-48a8-9aff-c46cea2ea4f8,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.713) (total time: 7223ms): Trace[1668221540]: [7.223002499s] [7.223002499s] END I0629 00:49:50.937032 1 trace.go:236] Trace[584169429]: "Get" accept:application/json, */*,audit-id:95209bad-9236-4f18-880d-0052a6a42341,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.713) (total time: 7223ms): Trace[584169429]: [7.223004939s] [7.223004939s] END I0629 00:49:50.937270 1 trace.go:236] Trace[769676007]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6bb18d45-e579-4d0e-bc03-82c267188529,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/storage-loki-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Jun-2026 00:49:43.719) (total time: 7217ms): Trace[769676007]: ---"About to write a response" 7217ms (00:49:50.937) Trace[769676007]: [7.217773433s] [7.217773433s] END I0629 00:49:50.937539 1 trace.go:236] Trace[146453499]: "Update" accept:application/json, */*,audit-id:d158b477-bbb7-4af7-aeb3-507493a75f61,client:10.0.0.93,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.15.5 (linux/amd64) cert-manager/e8fdbe63fd94107a83d3c9f9c134f2d222ba9cff,verb:PUT (29-Jun-2026 00:49:45.697) (total time: 5239ms): Trace[146453499]: ["GuaranteedUpdate etcd3" audit-id:d158b477-bbb7-4af7-aeb3-507493a75f61,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 5239ms (00:49:45.698)] Trace[146453499]: [5.239513533s] [5.239513533s] END I0629 00:49:50.937562 1 trace.go:236] Trace[1795460632]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ed6af048-981f-4fb4-8c74-5b09a3d722ed,client:10.0.0.200,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:46.162) (total time: 4774ms): Trace[1795460632]: ---"About to write a response" 4774ms (00:49:50.937) Trace[1795460632]: [4.774716751s] [4.774716751s] END I0629 00:49:50.937850 1 trace.go:236] Trace[89622570]: "Get" accept:application/json, */*,audit-id:5ecc3bbc-e5ba-432a-ab61-0ae40fee56c9,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7222ms): Trace[89622570]: ---"About to write a response" 7222ms (00:49:50.937) Trace[89622570]: [7.222826384s] [7.222826384s] END I0629 00:49:50.938061 1 trace.go:236] Trace[1816918068]: "Get" accept:application/json, */*,audit-id:66dd22a2-c9fd-4baa-a2f7-8ae7a1ad1cf4,client:10.0.0.199,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.718) (total time: 7220ms): Trace[1816918068]: ---"About to write a response" 7219ms (00:49:50.937) Trace[1816918068]: [7.220014827s] [7.220014827s] END I0629 00:49:50.938112 1 trace.go:236] Trace[2016481996]: "Get" accept:application/json, */*,audit-id:4d3c3337-9161-478a-97d1-7cb48ae241c8,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.713) (total time: 7224ms): Trace[2016481996]: [7.224684392s] [7.224684392s] END I0629 00:49:50.937713 1 trace.go:236] Trace[2096422862]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a451e2ce-4641-48e4-a3c4-e840f990a59a,client:10.0.0.211,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Jun-2026 00:49:46.623) (total time: 4314ms): Trace[2096422862]: ---"About to write a response" 4314ms (00:49:50.937) Trace[2096422862]: [4.31444646s] [4.31444646s] END I0629 00:49:50.938243 1 trace.go:236] Trace[1778714622]: "Get" accept:application/json, */*,audit-id:492a907a-0438-4aa6-8f3a-78f7bef1d85d,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-skfw8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.726) (total time: 7211ms): Trace[1778714622]: ---"About to write a response" 7211ms (00:49:50.937) Trace[1778714622]: [7.211872933s] [7.211872933s] END I0629 00:49:50.938310 1 trace.go:236] Trace[136274117]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:83f422e0-f8a1-4eb3-822b-f7551a8aec5f,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:48.387) (total time: 2550ms): Trace[136274117]: ["GuaranteedUpdate etcd3" audit-id:83f422e0-f8a1-4eb3-822b-f7551a8aec5f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2550ms (00:49:48.387) Trace[136274117]: ---"Txn call completed" 2549ms (00:49:50.938)] Trace[136274117]: [2.550666678s] [2.550666678s] END I0629 00:49:50.938377 1 trace.go:236] Trace[1590512172]: "Get" accept:application/json, */*,audit-id:0ce3dbc5-2f7b-4d3c-aae5-0450726b5e7e,client:10.0.0.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.713) (total time: 7225ms): Trace[1590512172]: [7.225002619s] [7.225002619s] END I0629 00:49:50.938449 1 trace.go:236] Trace[98322108]: "Get" accept:application/json, */*,audit-id:33d07397-5f1c-413c-a272-2e02136044cd,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-compute-default-7fch8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.751) (total time: 7186ms): Trace[98322108]: ---"About to write a response" 7186ms (00:49:50.937) Trace[98322108]: [7.186963929s] [7.186963929s] END I0629 00:49:50.938531 1 trace.go:236] Trace[2008073843]: "Get" accept:application/json, */*,audit-id:a5d7280f-cc28-4f5d-835e-91c3622f1e5e,client:10.0.0.125,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-cell-setup-fnls8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.757) (total time: 7181ms): Trace[2008073843]: ---"About to write a response" 7181ms (00:49:50.938) Trace[2008073843]: [7.181445738s] [7.181445738s] END I0629 00:49:50.938685 1 trace.go:236] Trace[913544868]: "Get" accept:application/json, */*,audit-id:cd2b031a-b5a5-48de-875e-3005ac8388a7,client:10.0.0.125,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.710) (total time: 7227ms): Trace[913544868]: ---"About to write a response" 7227ms (00:49:50.938) Trace[913544868]: [7.227911778s] [7.227911778s] END I0629 00:49:50.938724 1 trace.go:236] Trace[5671707]: "Get" accept:application/json, */*,audit-id:9b6a35fa-1bf6-4742-9ddb-cfc3e7f8cf47,client:10.0.0.125,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7224ms): Trace[5671707]: [7.224295184s] [7.224295184s] END I0629 00:49:50.938772 1 trace.go:236] Trace[1442513277]: "Get" accept:application/json, */*,audit-id:b97c1824-ae6b-48c7-a517-bfa653d3b878,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7224ms): Trace[1442513277]: [7.224507809s] [7.224507809s] END I0629 00:49:50.938838 1 trace.go:236] Trace[395354085]: "Get" accept:application/json, */*,audit-id:ad729301-683c-4102-8399-b1e040df762b,client:10.0.0.125,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7224ms): Trace[395354085]: ---"About to write a response" 7223ms (00:49:50.938) Trace[395354085]: [7.22409724s] [7.22409724s] END I0629 00:49:50.938890 1 trace.go:236] Trace[205038848]: "Get" accept:application/json, */*,audit-id:20cc72ea-2f67-456e-bb68-cab38b1ceb8f,client:199.204.45.246,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7224ms): Trace[205038848]: ---"About to write a response" 7224ms (00:49:50.938) Trace[205038848]: [7.224746724s] [7.224746724s] END I0629 00:49:50.938957 1 trace.go:236] Trace[1740059443]: "Get" accept:application/json, */*,audit-id:bb32390f-9a96-4f00-8ac4-c1799dec418d,client:10.0.0.199,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.718) (total time: 7220ms): Trace[1740059443]: [7.220390885s] [7.220390885s] END I0629 00:49:50.938972 1 trace.go:236] Trace[1501224981]: "Get" accept:application/json, */*,audit-id:344fce13-bdc1-4ae6-8a63-ada88c347b26,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7224ms): Trace[1501224981]: [7.22413642s] [7.22413642s] END I0629 00:49:50.939008 1 trace.go:236] Trace[1413353218]: "Get" accept:application/json, */*,audit-id:1dbb220b-eb86-4b4c-aa21-86401e2f7c4d,client:10.0.0.199,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.718) (total time: 7220ms): Trace[1413353218]: ---"About to write a response" 7219ms (00:49:50.937) Trace[1413353218]: [7.220809654s] [7.220809654s] END I0629 00:49:50.939024 1 trace.go:236] Trace[1859827968]: "Get" accept:application/json, */*,audit-id:0acaad32-2c3a-45b5-a0cc-6502f89f7c5d,client:10.0.0.191,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.710) (total time: 7228ms): Trace[1859827968]: ---"About to write a response" 7227ms (00:49:50.937) Trace[1859827968]: [7.228606082s] [7.228606082s] END I0629 00:49:50.939100 1 trace.go:236] Trace[466135844]: "Get" accept:application/json, */*,audit-id:a628dbae-4a75-40fa-9ff7-b65b58f1a03b,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/libvirt-libvirt-default-2hfbm,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.749) (total time: 7189ms): Trace[466135844]: ---"About to write a response" 7189ms (00:49:50.938) Trace[466135844]: [7.189820518s] [7.189820518s] END I0629 00:49:50.938982 1 trace.go:236] Trace[893156174]: "Get" accept:application/json, */*,audit-id:b6a29150-0b1b-42f1-bba4-b4702a496d57,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:44.149) (total time: 6789ms): Trace[893156174]: [6.789305825s] [6.789305825s] END I0629 00:49:50.939159 1 trace.go:236] Trace[604534005]: "Get" accept:application/json, */*,audit-id:b73ca121-49aa-487e-8d4d-3ef0396b7d67,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-metadata,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.712) (total time: 7226ms): Trace[604534005]: ---"About to write a response" 7226ms (00:49:50.939) Trace[604534005]: [7.226146302s] [7.226146302s] END I0629 00:49:50.939208 1 trace.go:236] Trace[1003358968]: "Get" accept:application/json, */*,audit-id:58f21739-2a18-4b6a-80b5-a1085bd5af02,client:199.204.45.246,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.711) (total time: 7227ms): Trace[1003358968]: [7.227251944s] [7.227251944s] END I0629 00:49:50.939311 1 trace.go:236] Trace[2091597635]: "Get" accept:application/json, */*,audit-id:c9928743-1b62-4e8d-a996-0449cfb0fa18,client:10.0.0.1,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.713) (total time: 7225ms): Trace[2091597635]: ---"About to write a response" 7225ms (00:49:50.939) Trace[2091597635]: [7.225398497s] [7.225398497s] END I0629 00:49:50.939314 1 trace.go:236] Trace[864597086]: "Get" accept:application/json, */*,audit-id:738f634a-1656-4e8c-8bb1-bf970fe44b8b,client:10.0.0.245,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.714) (total time: 7224ms): Trace[864597086]: ---"About to write a response" 7223ms (00:49:50.938) Trace[864597086]: [7.224580311s] [7.224580311s] END I0629 00:49:50.939517 1 trace.go:236] Trace[546475335]: "Get" accept:application/json, */*,audit-id:0242210a-0f04-46aa-adbe-8c96635a1d8c,client:199.204.45.246,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/neutron-server,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.709) (total time: 7230ms): Trace[546475335]: [7.230410308s] [7.230410308s] END I0629 00:49:50.940098 1 trace.go:236] Trace[1951812629]: "Get" accept:application/json, */*,audit-id:9031f9c4-4522-449f-a6b2-2c3e3fe80058,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/nova-compute-default-7fch8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.759) (total time: 7180ms): Trace[1951812629]: ---"About to write a response" 7179ms (00:49:50.938) Trace[1951812629]: [7.180302765s] [7.180302765s] END I0629 00:49:50.937526 1 trace.go:236] Trace[656371607]: "Get" accept:application/json, */*,audit-id:416d3250-9a43-494b-951c-724c0216eafa,client:10.0.0.157,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/nova-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.709) (total time: 7227ms): Trace[656371607]: ---"About to write a response" 7227ms (00:49:50.937) Trace[656371607]: [7.227866577s] [7.227866577s] END I0629 00:49:50.942152 1 trace.go:236] Trace[579707998]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3e78853c-23e5-4021-93b3-a59f052ad27d,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Jun-2026 00:49:48.557) (total time: 2384ms): Trace[579707998]: ["GuaranteedUpdate etcd3" audit-id:3e78853c-23e5-4021-93b3-a59f052ad27d,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2384ms (00:49:48.557) Trace[579707998]: ---"Txn call completed" 2383ms (00:49:50.941)] Trace[579707998]: [2.384749073s] [2.384749073s] END I0629 00:49:50.942581 1 trace.go:236] Trace[463049594]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5282c26e-8f75-4ee9-af81-8dbad14f6886,client:199.204.45.246,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Jun-2026 00:49:49.256) (total time: 1686ms): Trace[463049594]: ---"About to write a response" 1685ms (00:49:50.942) Trace[463049594]: [1.686435956s] [1.686435956s] END I0629 00:49:50.942827 1 trace.go:236] Trace[1237828047]: "Get" accept:application/json, */*,audit-id:b535a748-3528-47e9-be0d-5c98cb98ee32,client:10.0.0.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/nova-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Jun-2026 00:49:43.717) (total time: 7225ms): Trace[1237828047]: ---"About to write a response" 7224ms (00:49:50.942) Trace[1237828047]: [7.225205993s] [7.225205993s] END I0629 00:49:50.944878 1 trace.go:236] Trace[1589262252]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:134321d2-11c8-42cd-9d81-94d902a4ce8d,client:199.204.45.246,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18bd66dc393a7556,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Jun-2026 00:49:49.106) (total time: 1837ms): Trace[1589262252]: ["GuaranteedUpdate etcd3" audit-id:134321d2-11c8-42cd-9d81-94d902a4ce8d,key:/events/kube-system/kube-apiserver-instance.18bd66dc393a7556,type:*core.Event,resource:events 1837ms (00:49:49.107) Trace[1589262252]: ---"initial value restored" 1830ms (00:49:50.937)] Trace[1589262252]: [1.83788647s] [1.83788647s] END I0629 00:49:50.958824 1 trace.go:236] Trace[1700840143]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.246,type:*v1.Endpoints,resource:apiServerIPInfo (29-Jun-2026 00:49:47.695) (total time: 3263ms): Trace[1700840143]: ---"initial value restored" 3246ms (00:49:50.942) Trace[1700840143]: [3.263399778s] [3.263399778s] END I0629 00:49:57.958231 1 trace.go:236] Trace[142585031]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:de833bd8-99e7-4990-bce9-c8dde790b964,client:199.204.45.246,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/monitoring/endpointslices/vector-headless-qql7w,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (29-Jun-2026 00:49:57.424) (total time: 532ms): Trace[142585031]: ["GuaranteedUpdate etcd3" audit-id:de833bd8-99e7-4990-bce9-c8dde790b964,key:/endpointslices/monitoring/vector-headless-qql7w,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 532ms (00:49:57.425) Trace[142585031]: ---"Txn call completed" 530ms (00:49:57.957)] Trace[142585031]: [532.766528ms] [532.766528ms] END I0629 00:49:57.958236 1 trace.go:236] Trace[393298304]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cee128c5-6428-4e84-8f2e-f915d85be9da,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-d6b5dc39-ad2e-43d6-aa0d-fc273513f953,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.201) (total time: 756ms): Trace[393298304]: ---"About to write a response" 756ms (00:49:57.957) Trace[393298304]: [756.754599ms] [756.754599ms] END I0629 00:49:57.958349 1 trace.go:236] Trace[1869722356]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eb4f275f-3dbb-4329-b52d-f338ea2d1ed8,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-6c9d6d4e-4df0-4de8-8282-ccca6cd956e3,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.201) (total time: 756ms): Trace[1869722356]: ---"About to write a response" 756ms (00:49:57.958) Trace[1869722356]: [756.500814ms] [756.500814ms] END I0629 00:49:57.958663 1 trace.go:236] Trace[765250019]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e1f00088-5d20-4d8c-b1fb-ca82d338437d,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-a5988ab6-bf39-4d39-b621-24c20f9b3e9d,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.200) (total time: 757ms): Trace[765250019]: ---"About to write a response" 757ms (00:49:57.958) Trace[765250019]: [757.912252ms] [757.912252ms] END I0629 00:49:57.959395 1 trace.go:236] Trace[1974836823]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8cc318b9-8d20-4727-984e-3c294c9fb2c9,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-97f47ead-2203-49d7-8307-4a65b6e98caa,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.201) (total time: 757ms): Trace[1974836823]: ---"About to write a response" 757ms (00:49:57.959) Trace[1974836823]: [757.813091ms] [757.813091ms] END I0629 00:49:57.959573 1 trace.go:236] Trace[182739762]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b8392337-16b0-47cd-a44e-e8ef15615b4f,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-de178ead-fcac-4c3a-a766-7681025815b5,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.202) (total time: 757ms): Trace[182739762]: ---"About to write a response" 757ms (00:49:57.959) Trace[182739762]: [757.403963ms] [757.403963ms] END I0629 00:49:57.959577 1 trace.go:236] Trace[1164926109]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:65e4cc90-05be-4e9e-bcd0-28f3c17d892b,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-f472f9db-4f38-41d4-bce3-945642afe7ac,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.201) (total time: 757ms): Trace[1164926109]: ---"About to write a response" 757ms (00:49:57.959) Trace[1164926109]: [757.73726ms] [757.73726ms] END I0629 00:49:57.959637 1 trace.go:236] Trace[674050277]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bbffc219-72a8-4e45-90b4-7644073282f4,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-2ecc41b8-c856-4000-977f-ad28a89807d7,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.202) (total time: 757ms): Trace[674050277]: ---"About to write a response" 756ms (00:49:57.959) Trace[674050277]: [757.072697ms] [757.072697ms] END I0629 00:49:57.959770 1 trace.go:236] Trace[2081494889]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6131a417-23cc-402e-b466-d81a9f7c1072,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-bc1fde08-b148-4014-9abe-068101a26608,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.201) (total time: 758ms): Trace[2081494889]: ---"About to write a response" 758ms (00:49:57.959) Trace[2081494889]: [758.686588ms] [758.686588ms] END I0629 00:49:57.959957 1 trace.go:236] Trace[1769854755]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a4be968d-f9a1-41ac-8f0e-5528dae5d099,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-f93049e5-e441-4889-9086-96985db712ea,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.201) (total time: 758ms): Trace[1769854755]: ---"About to write a response" 758ms (00:49:57.959) Trace[1769854755]: [758.337802ms] [758.337802ms] END I0629 00:49:57.961435 1 trace.go:236] Trace[479704978]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3da79224-36f1-4c03-8720-11d1a0c2493c,client:199.204.45.246,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-7d071696-9cdc-4d12-b8ca-3e0b48d9e45e,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:expand-controller,verb:GET (29-Jun-2026 00:49:57.202) (total time: 759ms): Trace[479704978]: ---"About to write a response" 759ms (00:49:57.961) Trace[479704978]: [759.24368ms] [759.24368ms] END I0629 00:49:57.961741 1 trace.go:236] Trace[74430216]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6fccd439-fb60-44a1-a718-8365e9abc8e7,client:199.204.45.246,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Jun-2026 00:49:57.447) (total time: 514ms): Trace[74430216]: ---"About to write a response" 514ms (00:49:57.961) Trace[74430216]: [514.638701ms] [514.638701ms] END I0629 00:52:40.354809 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-neutron" clusterIPs={"IPv4":"10.105.139.106"} I0629 00:53:16.098029 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-server" clusterIPs={"IPv4":"10.106.115.19"} E0629 00:53:26.595965 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc027b45ef0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc012246a50), ResponseWriter:(*httpsnoop.rw)(0xc012246a50), Flusher:(*httpsnoop.rw)(0xc012246a50), CloseNotifier:(*httpsnoop.rw)(0xc012246a50), Pusher:(*httpsnoop.rw)(0xc012246a50)}}, encoder:(*versioning.codec)(0xc02c9326e0), memAllocator:(*runtime.Allocator)(0xc01f54f770)})