I0623 18:47:50.479750 1 feature_gate.go:245] feature gates: &{map[]} I0623 18:47:50.479866 1 csi-provisioner.go:139] Version: v3.1.0 I0623 18:47:50.479881 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0623 18:47:50.480308 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0623 18:48:00.480644 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0623 18:48:10.481229 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0623 18:48:12.396153 1 common.go:111] Probing CSI driver for readiness I0623 18:48:12.396272 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0623 18:48:12.396292 1 connection.go:184] GRPC request: {} I0623 18:48:12.402128 1 connection.go:186] GRPC response: {} I0623 18:48:12.402258 1 connection.go:187] GRPC error: I0623 18:48:12.402292 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0623 18:48:12.402315 1 connection.go:184] GRPC request: {} I0623 18:48:12.402993 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0623 18:48:12.403051 1 connection.go:187] GRPC error: I0623 18:48:12.403060 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0623 18:48:12.403065 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0623 18:48:12.403124 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0623 18:48:12.403613 1 common.go:111] Probing CSI driver for readiness I0623 18:48:12.403643 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0623 18:48:12.403648 1 connection.go:184] GRPC request: {} I0623 18:48:12.404444 1 connection.go:186] GRPC response: {} I0623 18:48:12.404461 1 connection.go:187] GRPC error: I0623 18:48:12.404470 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0623 18:48:12.404473 1 connection.go:184] GRPC request: {} I0623 18:48:12.405128 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0623 18:48:12.405325 1 connection.go:187] GRPC error: I0623 18:48:12.405353 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0623 18:48:12.405381 1 connection.go:184] GRPC request: {} I0623 18:48:12.406394 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0623 18:48:12.406476 1 connection.go:187] GRPC error: I0623 18:48:12.406512 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0623 18:48:12.406931 1 controller.go:732] Using saving PVs to API server in background I0623 18:48:12.407217 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0623 18:48:12.419265 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0623 18:48:12.419283 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-pvcdq I0623 18:48:12.419530 1 leader_election.go:205] became leader, starting I0623 18:48:12.419854 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0623 18:48:12.419876 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0623 18:48:12.420080 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0623 18:48:12.420098 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0623 18:48:12.428221 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:12.520578 1 shared_informer.go:270] caches populated I0623 18:48:12.520614 1 shared_informer.go:270] caches populated I0623 18:48:12.520626 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-pvcdq_63b207f9-1486-4a19-9f7f-0cb8e7bc70d5! I0623 18:48:12.520664 1 clone_controller.go:66] Starting CloningProtection controller I0623 18:48:12.520716 1 clone_controller.go:82] Started CloningProtection controller I0623 18:48:12.520737 1 volume_store.go:97] Starting save volume queue I0623 18:48:12.521000 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0623 18:48:12.521015 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0623 18:48:12.522165 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0623 18:48:12.522181 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0623 18:48:12.621047 1 shared_informer.go:270] caches populated I0623 18:48:12.621508 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-pvcdq_63b207f9-1486-4a19-9f7f-0cb8e7bc70d5! I0623 18:48:17.437939 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:22.446917 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:27.456182 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:32.466537 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:37.476162 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:42.485742 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:47.494491 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:52.503958 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:48:57.512779 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:02.522478 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:07.529083 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:12.539343 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:17.550481 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:22.561825 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:27.573216 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:32.584224 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:37.596908 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:42.605259 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:47.613418 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:52.624267 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:49:57.634213 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:02.644985 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:07.654735 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:12.665488 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:17.674601 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:22.684124 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:27.694483 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:32.702241 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:37.711063 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:42.720347 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:47.729096 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:52.737754 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:50:57.746570 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:02.754700 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:07.764340 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:12.772320 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:17.780606 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:22.788369 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:27.798674 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:32.806135 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:37.813970 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:42.823316 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:47.833659 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:52.841687 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:51:55.785878 1 controller.go:1337] provision "default/test-pvc" class "general": started I0623 18:51:55.785947 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0623 18:51:55.786366 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"209def2f-4096-4f5c-a322-603b8fc77527", APIVersion:"v1", ResourceVersion:"2468", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0623 18:51:55.795290 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0623 18:51:55.795313 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-209def2f-4096-4f5c-a322-603b8fc77527","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-209def2f-4096-4f5c-a322-603b8fc77527","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0623 18:51:55.908237 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-209def2f-4096-4f5c-a322-603b8fc77527","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-9b365e99-6f34-11f1-a037-da901caea7ea","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-9b365e99-6f34-11f1-a037-da901caea7ea"}} I0623 18:51:55.908367 1 connection.go:187] GRPC error: I0623 18:51:55.908376 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-9b365e99-6f34-11f1-a037-da901caea7ea VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-209def2f-4096-4f5c-a322-603b8fc77527 csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-9b365e99-6f34-11f1-a037-da901caea7ea journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0623 18:51:55.908415 1 controller.go:858] successfully created PV pvc-209def2f-4096-4f5c-a322-603b8fc77527 for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-9b365e99-6f34-11f1-a037-da901caea7ea I0623 18:51:55.908429 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-9b365e99-6f34-11f1-a037-da901caea7ea,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-209def2f-4096-4f5c-a322-603b8fc77527,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-9b365e99-6f34-11f1-a037-da901caea7ea,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1782240492406-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0623 18:51:55.908644 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-209def2f-4096-4f5c-a322-603b8fc77527" provisioned I0623 18:51:55.908653 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0623 18:51:55.908658 1 volume_store.go:154] Saving volume pvc-209def2f-4096-4f5c-a322-603b8fc77527 I0623 18:51:55.916098 1 volume_store.go:157] Volume pvc-209def2f-4096-4f5c-a322-603b8fc77527 saved I0623 18:51:55.916152 1 controller.go:1069] Claim processing succeeded, removing PVC 209def2f-4096-4f5c-a322-603b8fc77527 from claims in progress I0623 18:51:55.916179 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"209def2f-4096-4f5c-a322-603b8fc77527", APIVersion:"v1", ResourceVersion:"2468", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-209def2f-4096-4f5c-a322-603b8fc77527 I0623 18:51:57.850436 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:02.861490 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:07.888114 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:12.898178 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:17.906077 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:22.915877 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:27.922426 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:32.929032 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0623 18:52:37.936813 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com