I0314 07:01:25.878193 1 options.go:220] external host was not specified, using 162.253.55.12 I0314 07:01:25.879009 1 server.go:148] Version: v1.28.13 I0314 07:01:25.879077 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0314 07:01:26.563878 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0314 07:01:26.573790 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0314 07:01:26.573839 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0314 07:01:26.575179 1 instance.go:298] Using reconciler: lease I0314 07:01:26.825921 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0314 07:01:26.825952 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0314 07:01:27.087591 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0314 07:01:27.088111 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0314 07:01:27.545851 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0314 07:01:27.572872 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0314 07:01:27.572903 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.572911 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.573547 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0314 07:01:27.573561 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0314 07:01:27.574485 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0314 07:01:27.575249 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0314 07:01:27.575262 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0314 07:01:27.575266 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0314 07:01:27.576767 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0314 07:01:27.576781 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0314 07:01:27.577683 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0314 07:01:27.577698 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.577702 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.578325 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0314 07:01:27.578338 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.578445 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0314 07:01:27.579261 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0314 07:01:27.580893 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0314 07:01:27.580907 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.580910 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.581377 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0314 07:01:27.581391 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.581395 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.582316 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0314 07:01:27.582330 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0314 07:01:27.583978 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0314 07:01:27.583989 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.583994 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.584770 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0314 07:01:27.584784 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.584788 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.586703 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0314 07:01:27.586715 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.586719 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.587751 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0314 07:01:27.588795 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0314 07:01:27.588808 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.588812 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.592063 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0314 07:01:27.592075 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0314 07:01:27.592078 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0314 07:01:27.592797 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0314 07:01:27.592809 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0314 07:01:27.592813 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0314 07:01:27.593288 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0314 07:01:27.593301 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0314 07:01:27.641675 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0314 07:01:27.641715 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0314 07:01:28.105341 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0314 07:01:28.105391 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0314 07:01:28.105790 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0314 07:01:28.106381 1 secure_serving.go:213] Serving securely on [::]:6443 I0314 07:01:28.106479 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0314 07:01:28.111896 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0314 07:01:28.111962 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0314 07:01:28.112047 1 available_controller.go:423] Starting AvailableConditionController I0314 07:01:28.112057 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0314 07:01:28.112129 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0314 07:01:28.112374 1 system_namespaces_controller.go:67] Starting system namespaces controller I0314 07:01:28.112410 1 aggregator.go:164] waiting for initial CRD sync... I0314 07:01:28.112430 1 controller.go:80] Starting OpenAPI V3 AggregationController I0314 07:01:28.112454 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0314 07:01:28.112876 1 gc_controller.go:78] Starting apiserver lease garbage collector I0314 07:01:28.112941 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0314 07:01:28.112973 1 controller.go:78] Starting OpenAPI AggregationController I0314 07:01:28.113274 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0314 07:01:28.113286 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0314 07:01:28.121068 1 controller.go:116] Starting legacy_token_tracking_controller I0314 07:01:28.121101 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0314 07:01:28.121860 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0314 07:01:28.122422 1 controller.go:134] Starting OpenAPI controller I0314 07:01:28.122916 1 controller.go:85] Starting OpenAPI V3 controller I0314 07:01:28.123002 1 gc_controller.go:78] Starting apiserver lease garbage collector I0314 07:01:28.123212 1 naming_controller.go:291] Starting NamingConditionController I0314 07:01:28.123408 1 establishing_controller.go:76] Starting EstablishingController I0314 07:01:28.123585 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0314 07:01:28.123734 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0314 07:01:28.123918 1 crd_finalizer.go:266] Starting CRDFinalizer I0314 07:01:28.125465 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0314 07:01:28.125799 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0314 07:01:28.134925 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0314 07:01:28.134946 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0314 07:01:28.164239 1 shared_informer.go:318] Caches are synced for node_authorizer E0314 07:01:28.208608 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0314 07:01:28.212371 1 cache.go:39] Caches are synced for AvailableConditionController controller I0314 07:01:28.212443 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0314 07:01:28.213004 1 apf_controller.go:379] Running API Priority and Fairness config worker I0314 07:01:28.213036 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0314 07:01:28.213391 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0314 07:01:28.214579 1 controller.go:624] quota admission added evaluator for: namespaces I0314 07:01:28.221603 1 shared_informer.go:318] Caches are synced for configmaps I0314 07:01:28.234994 1 shared_informer.go:318] Caches are synced for crd-autoregister I0314 07:01:28.235105 1 aggregator.go:166] initial CRD sync complete... I0314 07:01:28.235166 1 autoregister_controller.go:141] Starting autoregister controller I0314 07:01:28.235178 1 cache.go:32] Waiting for caches to sync for autoregister controller I0314 07:01:28.235189 1 cache.go:39] Caches are synced for autoregister controller I0314 07:01:28.237838 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0314 07:01:29.127002 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0314 07:01:29.132302 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0314 07:01:29.132320 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0314 07:01:29.673785 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0314 07:01:29.738378 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0314 07:01:29.821936 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0314 07:01:29.844331 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.12] I0314 07:01:29.845871 1 controller.go:624] quota admission added evaluator for: endpoints I0314 07:01:29.854575 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0314 07:01:31.540442 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0314 07:01:31.548439 1 controller.go:624] quota admission added evaluator for: deployments.apps I0314 07:01:31.566691 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0314 07:01:31.764013 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0314 07:01:36.504748 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0314 07:01:36.753585 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0314 07:02:05.160847 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0314 07:02:05.169546 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0314 07:02:05.354785 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0314 07:02:05.761425 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0314 07:02:05.960052 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0314 07:02:06.177762 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0314 07:02:06.496605 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0314 07:02:06.584000 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0314 07:02:07.169928 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0314 07:02:08.800625 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0314 07:02:09.192737 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0314 07:02:14.935775 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0314 07:03:01.385743 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.104.164.251"} I0314 07:03:01.390769 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.100.178.217"}