I0721 06:48:32.032049 1 feature_gate.go:245] feature gates: &{map[]} I0721 06:48:32.032139 1 csi-provisioner.go:139] Version: v3.1.0 I0721 06:48:32.032145 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0721 06:48:32.032809 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0721 06:48:42.033846 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0721 06:48:52.084187 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0721 06:49:00.616061 1 common.go:111] Probing CSI driver for readiness I0721 06:49:00.616149 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0721 06:49:00.616162 1 connection.go:184] GRPC request: {} I0721 06:49:00.619944 1 connection.go:186] GRPC response: {} I0721 06:49:00.620026 1 connection.go:187] GRPC error: I0721 06:49:00.620037 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0721 06:49:00.620042 1 connection.go:184] GRPC request: {} I0721 06:49:00.621038 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0721 06:49:00.621186 1 connection.go:187] GRPC error: I0721 06:49:00.621206 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0721 06:49:00.621351 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0721 06:49:00.621580 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0721 06:49:00.624041 1 common.go:111] Probing CSI driver for readiness I0721 06:49:00.624064 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0721 06:49:00.624069 1 connection.go:184] GRPC request: {} I0721 06:49:00.624813 1 connection.go:186] GRPC response: {} I0721 06:49:00.624844 1 connection.go:187] GRPC error: I0721 06:49:00.624857 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0721 06:49:00.624863 1 connection.go:184] GRPC request: {} I0721 06:49:00.626117 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0721 06:49:00.626324 1 connection.go:187] GRPC error: I0721 06:49:00.626336 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0721 06:49:00.626342 1 connection.go:184] GRPC request: {} I0721 06:49:00.627172 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0721 06:49:00.627292 1 connection.go:187] GRPC error: I0721 06:49:00.627352 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0721 06:49:00.627898 1 controller.go:732] Using saving PVs to API server in background I0721 06:49:00.628304 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0721 06:49:00.639180 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0721 06:49:00.639376 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-dqxxp I0721 06:49:00.639523 1 leader_election.go:205] became leader, starting I0721 06:49:00.639936 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0721 06:49:00.639954 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0721 06:49:00.640299 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0721 06:49:00.640381 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0721 06:49:00.646296 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:00.740692 1 shared_informer.go:270] caches populated I0721 06:49:00.740739 1 shared_informer.go:270] caches populated I0721 06:49:00.740757 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-dqxxp_a77df88e-3a42-47b2-bb19-c7540d805203! I0721 06:49:00.740825 1 clone_controller.go:66] Starting CloningProtection controller I0721 06:49:00.740891 1 clone_controller.go:82] Started CloningProtection controller I0721 06:49:00.740957 1 volume_store.go:97] Starting save volume queue I0721 06:49:00.741262 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0721 06:49:00.741285 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0721 06:49:00.741605 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0721 06:49:00.741634 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0721 06:49:00.841571 1 shared_informer.go:270] caches populated I0721 06:49:00.842441 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-dqxxp_a77df88e-3a42-47b2-bb19-c7540d805203! I0721 06:49:06.923306 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:11.930207 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:16.937833 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:21.950954 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:26.959745 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:31.968923 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:36.983817 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:41.993132 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:47.001074 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:52.020711 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:49:57.029897 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:02.041203 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:07.056832 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:12.065268 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:17.077659 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:22.089072 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:27.098290 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:32.106140 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:37.115183 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:42.124256 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:47.131952 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:52.139421 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:50:57.148230 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:02.159065 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:07.169251 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:12.177873 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:17.190012 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:22.201455 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:27.211815 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:32.223373 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:37.231258 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:42.241776 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:47.252334 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:52.261703 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:51:57.272252 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:02.285016 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:07.294818 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:12.302718 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:17.312977 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:22.324170 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:27.335042 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:32.343938 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:37.355480 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:42.362724 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:47.373845 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:52.382963 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:52:57.393409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:02.403041 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:07.412344 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:12.425460 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:14.869081 1 controller.go:1337] provision "default/test-pvc" class "general": started I0721 06:53:14.869163 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0721 06:53:14.869844 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"7346ff74-3b19-4918-bb71-63cc9594abf9", APIVersion:"v1", ResourceVersion:"2613", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0721 06:53:14.873228 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0721 06:53:14.873251 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-7346ff74-3b19-4918-bb71-63cc9594abf9","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-7346ff74-3b19-4918-bb71-63cc9594abf9","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0721 06:53:14.978386 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-7346ff74-3b19-4918-bb71-63cc9594abf9","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-d8b4395d-84d0-11f1-8661-b6e438b233a9","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-d8b4395d-84d0-11f1-8661-b6e438b233a9"}} I0721 06:53:14.978555 1 connection.go:187] GRPC error: I0721 06:53:14.978566 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-d8b4395d-84d0-11f1-8661-b6e438b233a9 VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-7346ff74-3b19-4918-bb71-63cc9594abf9 csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-d8b4395d-84d0-11f1-8661-b6e438b233a9 journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0721 06:53:14.978614 1 controller.go:858] successfully created PV pvc-7346ff74-3b19-4918-bb71-63cc9594abf9 for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-d8b4395d-84d0-11f1-8661-b6e438b233a9 I0721 06:53:14.978632 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-d8b4395d-84d0-11f1-8661-b6e438b233a9,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-7346ff74-3b19-4918-bb71-63cc9594abf9,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-d8b4395d-84d0-11f1-8661-b6e438b233a9,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1784616540627-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0721 06:53:14.978796 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-7346ff74-3b19-4918-bb71-63cc9594abf9" provisioned I0721 06:53:14.978810 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0721 06:53:14.978816 1 volume_store.go:154] Saving volume pvc-7346ff74-3b19-4918-bb71-63cc9594abf9 I0721 06:53:14.985759 1 volume_store.go:157] Volume pvc-7346ff74-3b19-4918-bb71-63cc9594abf9 saved I0721 06:53:14.985857 1 controller.go:1069] Claim processing succeeded, removing PVC 7346ff74-3b19-4918-bb71-63cc9594abf9 from claims in progress I0721 06:53:14.986052 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"7346ff74-3b19-4918-bb71-63cc9594abf9", APIVersion:"v1", ResourceVersion:"2613", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-7346ff74-3b19-4918-bb71-63cc9594abf9 I0721 06:53:17.435063 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:22.444112 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:27.452414 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:32.466663 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:37.476482 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:42.481899 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:47.492281 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:52.505781 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:53:57.518970 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:54:02.529234 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0721 06:54:07.536328 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com