I0409 06:01:51.643388 1 feature_gate.go:245] feature gates: &{map[]} I0409 06:01:51.643448 1 csi-provisioner.go:139] Version: v3.1.0 I0409 06:01:51.643452 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0409 06:01:51.643874 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0409 06:02:01.644909 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0409 06:02:11.644519 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0409 06:02:16.330923 1 common.go:111] Probing CSI driver for readiness I0409 06:02:16.330958 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0409 06:02:16.330973 1 connection.go:184] GRPC request: {} I0409 06:02:16.340768 1 connection.go:186] GRPC response: {} I0409 06:02:16.340868 1 connection.go:187] GRPC error: I0409 06:02:16.340882 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0409 06:02:16.340886 1 connection.go:184] GRPC request: {} I0409 06:02:16.342052 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0409 06:02:16.342206 1 connection.go:187] GRPC error: I0409 06:02:16.342245 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0409 06:02:16.342260 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0409 06:02:16.342423 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0409 06:02:16.343197 1 common.go:111] Probing CSI driver for readiness I0409 06:02:16.343212 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0409 06:02:16.343216 1 connection.go:184] GRPC request: {} I0409 06:02:16.343762 1 connection.go:186] GRPC response: {} I0409 06:02:16.343782 1 connection.go:187] GRPC error: I0409 06:02:16.343792 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0409 06:02:16.343795 1 connection.go:184] GRPC request: {} I0409 06:02:16.345269 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0409 06:02:16.345446 1 connection.go:187] GRPC error: I0409 06:02:16.345463 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0409 06:02:16.345468 1 connection.go:184] GRPC request: {} I0409 06:02:16.346974 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0409 06:02:16.347282 1 connection.go:187] GRPC error: I0409 06:02:16.347496 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0409 06:02:16.349037 1 controller.go:732] Using saving PVs to API server in background I0409 06:02:16.350244 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0409 06:02:16.371296 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0409 06:02:16.371536 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-tmrjj I0409 06:02:16.371646 1 leader_election.go:205] became leader, starting I0409 06:02:16.372102 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0409 06:02:16.372135 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0409 06:02:16.372241 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0409 06:02:16.372270 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0409 06:02:16.377692 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:16.472948 1 shared_informer.go:270] caches populated I0409 06:02:16.473023 1 shared_informer.go:270] caches populated I0409 06:02:16.473045 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-tmrjj_0d02bf72-7edb-4daf-abf2-58a8f489458b! I0409 06:02:16.473117 1 clone_controller.go:66] Starting CloningProtection controller I0409 06:02:16.473156 1 volume_store.go:97] Starting save volume queue I0409 06:02:16.473399 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0409 06:02:16.473434 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0409 06:02:16.473465 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0409 06:02:16.473483 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0409 06:02:16.473195 1 clone_controller.go:82] Started CloningProtection controller I0409 06:02:16.573931 1 shared_informer.go:270] caches populated I0409 06:02:16.575227 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-tmrjj_0d02bf72-7edb-4daf-abf2-58a8f489458b! I0409 06:02:21.390510 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:26.398280 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:31.408752 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:36.418112 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:41.427841 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:46.438159 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:51.447240 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:02:56.457272 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:01.467311 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:06.477373 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:11.486679 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:16.497943 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:21.506871 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:26.516618 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:31.526090 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:36.535346 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:41.543826 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:46.552541 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:51.562178 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:03:56.570171 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:01.580112 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:06.590989 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:11.601449 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:16.613357 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:21.620005 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:26.627964 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:31.634743 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:36.642071 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:41.650377 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:46.659115 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:51.669908 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:04:56.682605 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:01.691846 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:06.704903 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:11.714942 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:16.726341 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:21.733755 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:26.742610 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:29.313218 1 controller.go:1337] provision "default/test-pvc" class "general": started I0409 06:05:29.313654 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0409 06:05:29.313748 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"26a85953-fdc8-4888-b280-c56d988679c2", APIVersion:"v1", ResourceVersion:"2346", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0409 06:05:29.316274 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0409 06:05:29.316304 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-26a85953-fdc8-4888-b280-c56d988679c2","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-26a85953-fdc8-4888-b280-c56d988679c2","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0409 06:05:30.651436 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-26a85953-fdc8-4888-b280-c56d988679c2","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-1c265f56-33da-11f1-8b22-9ac46624f04b","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-1c265f56-33da-11f1-8b22-9ac46624f04b"}} I0409 06:05:30.651896 1 connection.go:187] GRPC error: I0409 06:05:30.651918 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-1c265f56-33da-11f1-8b22-9ac46624f04b VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-26a85953-fdc8-4888-b280-c56d988679c2 csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-1c265f56-33da-11f1-8b22-9ac46624f04b journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0409 06:05:30.652081 1 controller.go:858] successfully created PV pvc-26a85953-fdc8-4888-b280-c56d988679c2 for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-1c265f56-33da-11f1-8b22-9ac46624f04b I0409 06:05:30.652252 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-1c265f56-33da-11f1-8b22-9ac46624f04b,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-26a85953-fdc8-4888-b280-c56d988679c2,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-1c265f56-33da-11f1-8b22-9ac46624f04b,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1775714536347-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0409 06:05:30.652467 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-26a85953-fdc8-4888-b280-c56d988679c2" provisioned I0409 06:05:30.652482 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0409 06:05:30.652489 1 volume_store.go:154] Saving volume pvc-26a85953-fdc8-4888-b280-c56d988679c2 I0409 06:05:30.662851 1 volume_store.go:157] Volume pvc-26a85953-fdc8-4888-b280-c56d988679c2 saved I0409 06:05:30.662913 1 controller.go:1069] Claim processing succeeded, removing PVC 26a85953-fdc8-4888-b280-c56d988679c2 from claims in progress I0409 06:05:30.663306 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"26a85953-fdc8-4888-b280-c56d988679c2", APIVersion:"v1", ResourceVersion:"2346", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-26a85953-fdc8-4888-b280-c56d988679c2 I0409 06:05:31.752141 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:36.761638 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:41.878035 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:46.887605 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:51.894548 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:05:56.902444 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:06:01.910698 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:06:06.918697 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0409 06:06:11.927306 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com