I0724 04:50:21.182916 1 feature_gate.go:245] feature gates: &{map[]} I0724 04:50:21.182961 1 csi-provisioner.go:139] Version: v3.1.0 I0724 04:50:21.182965 1 csi-provisioner.go:162] Building kube configs for running in cluster... I0724 04:50:21.183359 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock W0724 04:50:31.183416 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock W0724 04:50:41.184055 1 connection.go:173] Still connecting to unix:///csi/csi-provisioner.sock I0724 04:50:44.437520 1 common.go:111] Probing CSI driver for readiness I0724 04:50:44.437551 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0724 04:50:44.437558 1 connection.go:184] GRPC request: {} I0724 04:50:44.441021 1 connection.go:186] GRPC response: {} I0724 04:50:44.441094 1 connection.go:187] GRPC error: I0724 04:50:44.441106 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo I0724 04:50:44.441111 1 connection.go:184] GRPC request: {} I0724 04:50:44.441826 1 connection.go:186] GRPC response: {"name":"rbd.csi.ceph.com","vendor_version":"v3.5.1"} I0724 04:50:44.441902 1 connection.go:187] GRPC error: I0724 04:50:44.441914 1 csi-provisioner.go:206] Detected CSI driver rbd.csi.ceph.com I0724 04:50:44.441956 1 csi-provisioner.go:216] Supports migration from in-tree plugin: kubernetes.io/rbd I0724 04:50:44.445841 1 connection.go:154] Connecting to unix:///csi/csi-provisioner.sock I0724 04:50:44.446437 1 common.go:111] Probing CSI driver for readiness I0724 04:50:44.446450 1 connection.go:183] GRPC call: /csi.v1.Identity/Probe I0724 04:50:44.446455 1 connection.go:184] GRPC request: {} I0724 04:50:44.447125 1 connection.go:186] GRPC response: {} I0724 04:50:44.447157 1 connection.go:187] GRPC error: I0724 04:50:44.447165 1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginCapabilities I0724 04:50:44.447191 1 connection.go:184] GRPC request: {} I0724 04:50:44.447972 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}},{"Type":{"Service":{"type":2}}}]} I0724 04:50:44.448175 1 connection.go:187] GRPC error: I0724 04:50:44.448187 1 connection.go:183] GRPC call: /csi.v1.Controller/ControllerGetCapabilities I0724 04:50:44.448193 1 connection.go:184] GRPC request: {} I0724 04:50:44.449020 1 connection.go:186] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}}]} I0724 04:50:44.449115 1 connection.go:187] GRPC error: I0724 04:50:44.449181 1 csi-provisioner.go:278] CSI driver does not support PUBLISH_UNPUBLISH_VOLUME, not watching VolumeAttachments I0724 04:50:44.449630 1 controller.go:732] Using saving PVs to API server in background I0724 04:50:44.450092 1 leaderelection.go:248] attempting to acquire leader lease kube-system/rbd-csi-ceph-com... I0724 04:50:44.462262 1 leaderelection.go:258] successfully acquired lease kube-system/rbd-csi-ceph-com I0724 04:50:44.462345 1 leader_election.go:212] new leader detected, current leader: ceph-csi-rbd-provisioner-6f6497f79c-c2s62 I0724 04:50:44.462377 1 leader_election.go:205] became leader, starting I0724 04:50:44.462651 1 reflector.go:219] Starting reflector *v1.StorageClass (1h0m0s) from k8s.io/client-go/informers/factory.go:134 I0724 04:50:44.462664 1 reflector.go:255] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:134 I0724 04:50:44.462966 1 reflector.go:219] Starting reflector *v1.PersistentVolumeClaim (15m0s) from k8s.io/client-go/informers/factory.go:134 I0724 04:50:44.462997 1 reflector.go:255] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:134 I0724 04:50:44.469761 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:50:44.563094 1 shared_informer.go:270] caches populated I0724 04:50:44.563135 1 shared_informer.go:270] caches populated I0724 04:50:44.563214 1 clone_controller.go:66] Starting CloningProtection controller I0724 04:50:44.563270 1 clone_controller.go:82] Started CloningProtection controller I0724 04:50:44.563148 1 controller.go:811] Starting provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-c2s62_b6ae3f5e-7d2d-4f6f-8377-4f87e887c58b! I0724 04:50:44.563450 1 volume_store.go:97] Starting save volume queue I0724 04:50:44.564998 1 reflector.go:219] Starting reflector *v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0724 04:50:44.565041 1 reflector.go:255] Listing and watching *v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:845 I0724 04:50:44.565318 1 reflector.go:219] Starting reflector *v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0724 04:50:44.565343 1 reflector.go:255] Listing and watching *v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/v8/controller/controller.go:848 I0724 04:50:44.664154 1 shared_informer.go:270] caches populated I0724 04:50:44.664634 1 controller.go:860] Started provisioner controller rbd.csi.ceph.com_ceph-csi-rbd-provisioner-6f6497f79c-c2s62_b6ae3f5e-7d2d-4f6f-8377-4f87e887c58b! I0724 04:50:49.478247 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:50:54.486829 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:50:59.495443 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:04.504201 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:09.512836 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:14.522174 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:19.532216 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:24.541219 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:29.552583 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:34.563185 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:39.574868 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:44.583794 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:49.592797 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:54.602900 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:51:59.609966 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:04.618341 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:09.628273 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:14.637718 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:19.647537 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:24.656412 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:29.665644 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:34.674889 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:39.689176 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:44.700412 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:49.708876 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:54.716746 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:52:59.723496 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:04.729012 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:09.741771 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:14.750832 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:19.759185 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:24.767426 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:29.778709 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:34.786846 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:39.796409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:44.808409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:49.816776 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:54.825932 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:53:59.840150 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:04.847353 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:09.857734 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:14.864592 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:19.873147 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:24.884023 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:29.893305 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:34.906712 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:39.915172 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:44.926114 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:49.938167 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:53.248608 1 controller.go:1337] provision "default/test-pvc" class "general": started I0724 04:54:53.248670 1 controller.go:528] skip translation of storage class for plugin: rbd.csi.ceph.com I0724 04:54:53.249164 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"7076a364-55a0-4305-b135-260245d59132", APIVersion:"v1", ResourceVersion:"2714", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/test-pvc" I0724 04:54:53.252338 1 connection.go:183] GRPC call: /csi.v1.Controller/CreateVolume I0724 04:54:53.252365 1 connection.go:184] GRPC request: {"capacity_range":{"required_bytes":5368709120},"name":"pvc-7076a364-55a0-4305-b135-260245d59132","parameters":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-7076a364-55a0-4305-b135-260245d59132","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","pool":"kube","thickProvision":"false"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4","mount_flags":["discard"]}},"access_mode":{"mode":1}}]} I0724 04:54:53.351154 1 connection.go:186] GRPC response: {"volume":{"capacity_bytes":5368709120,"volume_context":{"clusterID":"4837cbf8-4f90-4300-b3f6-726c9b9f89b4","csi.storage.k8s.io/pv/name":"pvc-7076a364-55a0-4305-b135-260245d59132","csi.storage.k8s.io/pvc/name":"test-pvc","csi.storage.k8s.io/pvc/namespace":"default","imageFeatures":"layering","imageName":"csi-vol-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e","journalPool":"kube","pool":"kube","thickProvision":"false"},"volume_id":"0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e"}} I0724 04:54:53.351356 1 connection.go:187] GRPC error: I0724 04:54:53.351370 1 controller.go:774] create volume rep: {CapacityBytes:5368709120 VolumeId:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e VolumeContext:map[clusterID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 csi.storage.k8s.io/pv/name:pvc-7076a364-55a0-4305-b135-260245d59132 csi.storage.k8s.io/pvc/name:test-pvc csi.storage.k8s.io/pvc/namespace:default imageFeatures:layering imageName:csi-vol-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e journalPool:kube pool:kube thickProvision:false] ContentSource: AccessibleTopology:[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0} I0724 04:54:53.351438 1 controller.go:858] successfully created PV pvc-7076a364-55a0-4305-b135-260245d59132 for PVC test-pvc and csi volume name 0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e I0724 04:54:53.351459 1 controller.go:874] successfully created PV {GCEPersistentDisk:nil AWSElasticBlockStore:nil HostPath:nil Glusterfs:nil NFS:nil RBD:nil ISCSI:nil Cinder:nil CephFS:nil FC:nil Flocker:nil FlexVolume:nil AzureFile:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil PortworxVolume:nil ScaleIO:nil Local:nil StorageOS:nil CSI:&CSIPersistentVolumeSource{Driver:rbd.csi.ceph.com,VolumeHandle:0001-0024-4837cbf8-4f90-4300-b3f6-726c9b9f89b4-0000000000000002-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e,ReadOnly:false,FSType:ext4,VolumeAttributes:map[string]string{clusterID: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4,csi.storage.k8s.io/pv/name: pvc-7076a364-55a0-4305-b135-260245d59132,csi.storage.k8s.io/pvc/name: test-pvc,csi.storage.k8s.io/pvc/namespace: default,imageFeatures: layering,imageName: csi-vol-cf0bb3b7-871b-11f1-abe8-a6a1660bd56e,journalPool: kube,pool: kube,storage.kubernetes.io/csiProvisionerIdentity: 1784868644449-8081-rbd.csi.ceph.com,thickProvision: false,},ControllerPublishSecretRef:nil,NodeStageSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},NodePublishSecretRef:nil,ControllerExpandSecretRef:&SecretReference{Name:csi-rbd-secret,Namespace:kube-system,},}} I0724 04:54:53.351660 1 controller.go:1442] provision "default/test-pvc" class "general": volume "pvc-7076a364-55a0-4305-b135-260245d59132" provisioned I0724 04:54:53.351673 1 controller.go:1455] provision "default/test-pvc" class "general": succeeded I0724 04:54:53.351681 1 volume_store.go:154] Saving volume pvc-7076a364-55a0-4305-b135-260245d59132 I0724 04:54:53.360067 1 volume_store.go:157] Volume pvc-7076a364-55a0-4305-b135-260245d59132 saved I0724 04:54:53.360312 1 controller.go:1069] Claim processing succeeded, removing PVC 7076a364-55a0-4305-b135-260245d59132 from claims in progress I0724 04:54:53.360353 1 event.go:285] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-pvc", UID:"7076a364-55a0-4305-b135-260245d59132", APIVersion:"v1", ResourceVersion:"2714", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-7076a364-55a0-4305-b135-260245d59132 I0724 04:54:54.948649 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:54:59.959711 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:04.970403 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:09.979564 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:14.988188 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:19.998340 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:25.005658 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:30.017513 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:35.025409 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:40.033815 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com I0724 04:55:45.046359 1 leaderelection.go:278] successfully renewed lease kube-system/rbd-csi-ceph-com