I0711 03:29:28.192754 1 options.go:220] external host was not specified, using 199.204.45.38 I0711 03:29:28.193776 1 server.go:148] Version: v1.28.13 I0711 03:29:28.193810 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0711 03:29:28.805983 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0711 03:29:28.820700 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0711 03:29:28.820771 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0711 03:29:28.821042 1 instance.go:298] Using reconciler: lease I0711 03:29:28.869808 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0711 03:29:28.869826 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0711 03:29:29.107702 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0711 03:29:29.107910 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0711 03:29:29.544110 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0711 03:29:29.556404 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0711 03:29:29.556430 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.556435 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.556736 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0711 03:29:29.556746 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0711 03:29:29.557330 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0711 03:29:29.557824 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0711 03:29:29.557833 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0711 03:29:29.557836 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0711 03:29:29.562409 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0711 03:29:29.562438 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0711 03:29:29.565203 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0711 03:29:29.565251 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.565302 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.567450 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0711 03:29:29.567482 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.568248 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0711 03:29:29.569205 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0711 03:29:29.571090 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0711 03:29:29.571273 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.571351 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.571891 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0711 03:29:29.571970 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.572009 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.572855 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0711 03:29:29.572929 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0711 03:29:29.574838 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0711 03:29:29.574884 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.574926 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.575402 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0711 03:29:29.575446 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.575466 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.580697 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0711 03:29:29.580728 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.580738 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.582498 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0711 03:29:29.583777 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0711 03:29:29.583794 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.583799 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.587904 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0711 03:29:29.587922 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0711 03:29:29.587927 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0711 03:29:29.588793 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0711 03:29:29.588808 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0711 03:29:29.588813 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0711 03:29:29.589391 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0711 03:29:29.589403 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0711 03:29:29.628345 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0711 03:29:29.628369 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0711 03:29:30.000011 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0711 03:29:30.000062 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0711 03:29:30.000162 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0711 03:29:30.000354 1 secure_serving.go:213] Serving securely on [::]:6443 I0711 03:29:30.000387 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0711 03:29:30.000462 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0711 03:29:30.000577 1 system_namespaces_controller.go:67] Starting system namespaces controller I0711 03:29:30.000599 1 controller.go:78] Starting OpenAPI AggregationController I0711 03:29:30.000616 1 aggregator.go:164] waiting for initial CRD sync... I0711 03:29:30.000709 1 controller.go:80] Starting OpenAPI V3 AggregationController I0711 03:29:30.000874 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0711 03:29:30.000923 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0711 03:29:30.000943 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0711 03:29:30.000967 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0711 03:29:30.000887 1 controller.go:116] Starting legacy_token_tracking_controller I0711 03:29:30.001006 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0711 03:29:30.001016 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0711 03:29:30.001039 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0711 03:29:30.001102 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0711 03:29:30.001132 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0711 03:29:30.001243 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0711 03:29:30.001435 1 gc_controller.go:78] Starting apiserver lease garbage collector I0711 03:29:30.001545 1 available_controller.go:423] Starting AvailableConditionController I0711 03:29:30.001605 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0711 03:29:30.001742 1 controller.go:134] Starting OpenAPI controller I0711 03:29:30.001772 1 controller.go:85] Starting OpenAPI V3 controller I0711 03:29:30.001793 1 naming_controller.go:291] Starting NamingConditionController I0711 03:29:30.001811 1 establishing_controller.go:76] Starting EstablishingController I0711 03:29:30.001827 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0711 03:29:30.001843 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0711 03:29:30.001858 1 crd_finalizer.go:266] Starting CRDFinalizer I0711 03:29:30.002210 1 gc_controller.go:78] Starting apiserver lease garbage collector I0711 03:29:30.002786 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0711 03:29:30.002815 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller E0711 03:29:30.079468 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0711 03:29:30.100969 1 apf_controller.go:379] Running API Priority and Fairness config worker I0711 03:29:30.100995 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0711 03:29:30.101057 1 shared_informer.go:318] Caches are synced for configmaps I0711 03:29:30.101207 1 shared_informer.go:318] Caches are synced for crd-autoregister I0711 03:29:30.101167 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0711 03:29:30.101301 1 aggregator.go:166] initial CRD sync complete... I0711 03:29:30.101338 1 autoregister_controller.go:141] Starting autoregister controller I0711 03:29:30.101372 1 cache.go:32] Waiting for caches to sync for autoregister controller I0711 03:29:30.101405 1 cache.go:39] Caches are synced for autoregister controller I0711 03:29:30.101829 1 cache.go:39] Caches are synced for AvailableConditionController controller I0711 03:29:30.102112 1 controller.go:624] quota admission added evaluator for: namespaces I0711 03:29:30.102892 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0711 03:29:30.106159 1 shared_informer.go:318] Caches are synced for node_authorizer I0711 03:29:30.283599 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0711 03:29:31.011156 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0711 03:29:31.015933 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0711 03:29:31.015947 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0711 03:29:32.295152 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0711 03:29:32.345274 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0711 03:29:32.413606 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0711 03:29:32.420919 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.38] I0711 03:29:32.422209 1 controller.go:624] quota admission added evaluator for: endpoints I0711 03:29:32.426407 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0711 03:29:34.187597 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0711 03:29:34.194612 1 controller.go:624] quota admission added evaluator for: deployments.apps I0711 03:29:34.253615 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0711 03:29:34.457832 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0711 03:29:38.594821 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0711 03:29:39.093799 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0711 03:30:05.114355 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0711 03:30:05.124710 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0711 03:30:05.124740 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0711 03:30:05.144424 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0711 03:30:05.175490 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0711 03:30:05.191747 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0711 03:30:05.200668 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0711 03:30:05.200697 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0711 03:30:05.214420 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0711 03:30:05.228472 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0711 03:30:05.303317 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0711 03:30:05.303370 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0711 03:30:05.332978 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0711 03:30:05.333046 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0711 03:30:05.368244 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0711 03:30:05.481902 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0711 03:30:05.482024 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0711 03:30:05.495665 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:05.551915 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:05.577325 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:05.607385 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:05.615880 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:06.266845 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:06.272245 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:06.369147 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0711 03:30:11.785960 1 controller.go:624] quota admission added evaluator for: jobs.batch I0711 03:30:12.938286 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0711 03:30:12.944382 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0711 03:30:13.123673 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0711 03:30:13.318644 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0711 03:30:13.538836 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0711 03:30:13.719314 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0711 03:30:13.927909 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0711 03:30:14.147689 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0711 03:30:16.159772 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0711 03:30:16.733279 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0711 03:30:17.161149 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0711 03:30:32.319200 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0711 03:30:32.319325 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0711 03:30:32.767508 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0711 03:30:40.636149 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.103.231.253"} W0711 03:30:40.690251 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.231.253:9443: connect: connection refused E0711 03:30:40.690408 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.231.253:9443: connect: connection refused I0711 03:32:21.263431 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.107.106.47"} I0711 03:32:21.271297 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.96.226.120"}