2026/04/12 21:07:54 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota
2026-04-12 21:07:54.097669 I | rookcmd: starting Rook v1.15.9 with arguments '/usr/local/bin/rook ceph operator'
2026-04-12 21:07:54.097696 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO
2026-04-12 21:07:54.097699 I | cephcmd: starting Rook-Ceph operator
2026-04-12 21:07:54.222275 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.4 (e7ad5345525c7aa95470c26863873b581076945d) reef (stable)"
2026-04-12 21:07:54.231537 I | op-k8sutil: operator setting "CSI_PROVISIONER_PRIORITY_CLASSNAME" = "system-cluster-critical"
2026-04-12 21:07:54.231566 I | op-k8sutil: operator setting "CSI_RBD_ATTACH_REQUIRED" = "true"
2026-04-12 21:07:54.231574 I | op-k8sutil: operator setting "CSI_RBD_FSGROUPPOLICY" = "File"
2026-04-12 21:07:54.231579 I | op-k8sutil: operator setting "CSI_PLUGIN_PRIORITY_CLASSNAME" = "system-node-critical"
2026-04-12 21:07:54.231586 I | op-k8sutil: operator setting "ROOK_CSI_CEPH_IMAGE" = "quay.io/cephcsi/cephcsi:v3.12.3"
2026-04-12 21:07:54.231590 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_CEPHFS" = "false"
2026-04-12 21:07:54.231593 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_NFS" = "false"
2026-04-12 21:07:54.231597 I | op-k8sutil: operator setting "CSI_ENABLE_NFS_SNAPSHOTTER" = "true"
2026-04-12 21:07:54.231600 I | op-k8sutil: operator setting "ROOK_CEPH_ALLOW_LOOP_DEVICES" = "false"
2026-04-12 21:07:54.231604 I | op-k8sutil: operator setting "CSI_ENABLE_CSIADDONS" = "false"
2026-04-12 21:07:54.231608 I | op-k8sutil: operator setting "CSI_ENABLE_HOST_NETWORK" = "true"
2026-04-12 21:07:54.231613 I | op-k8sutil: operator setting "ROOK_CSI_PROVISIONER_IMAGE" = "registry.k8s.io/sig-storage/csi-provisioner:v5.0.1"
2026-04-12 21:07:54.231618 I | op-k8sutil: operator setting "ROOK_CSI_REGISTRAR_IMAGE" = "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.11.1"
2026-04-12 21:07:54.231622 I | op-k8sutil: operator setting "ROOK_LOG_LEVEL" = "INFO"
2026-04-12 21:07:54.231627 I | op-k8sutil: operator setting "ROOK_CSIADDONS_IMAGE" = "quay.io/csiaddons/k8s-sidecar:v0.9.1"
2026-04-12 21:07:54.231632 I | op-k8sutil: operator setting "ROOK_CSI_ATTACHER_IMAGE" = "registry.k8s.io/sig-storage/csi-attacher:v4.6.1"
2026-04-12 21:07:54.231645 I | op-k8sutil: operator setting "CSI_CEPHFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-resizer\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-snapshotter\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-cephfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-12 21:07:54.231656 I | op-k8sutil: operator setting "CSI_ENABLE_METADATA" = "false"
2026-04-12 21:07:54.231660 I | op-k8sutil: operator setting "CSI_ENABLE_OMAP_GENERATOR" = "false"
2026-04-12 21:07:54.231664 I | op-k8sutil: operator setting "CSI_ENABLE_TOPOLOGY" = "false"
2026-04-12 21:07:54.231668 I | op-k8sutil: operator setting "CSI_NFS_FSGROUPPOLICY" = "File"
2026-04-12 21:07:54.231674 I | op-k8sutil: operator setting "CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT" = "false"
2026-04-12 21:07:54.231683 I | op-k8sutil: operator setting "ROOK_CSI_SNAPSHOTTER_IMAGE" = "registry.k8s.io/sig-storage/csi-snapshotter:v8.0.1"
2026-04-12 21:07:54.231687 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_RBD" = "false"
2026-04-12 21:07:54.231691 I | op-k8sutil: operator setting "ROOK_CSI_IMAGE_PULL_POLICY" = "IfNotPresent"
2026-04-12 21:07:54.231695 I | op-k8sutil: operator setting "CSI_ENABLE_CEPHFS_SNAPSHOTTER" = "true"
2026-04-12 21:07:54.231699 I | op-k8sutil: operator setting "CSI_ENABLE_RBD_SNAPSHOTTER" = "true"
2026-04-12 21:07:54.231710 I | op-k8sutil: operator setting "CSI_NFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-nfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n"
2026-04-12 21:07:54.231720 I | op-k8sutil: operator setting "CSI_PROVISIONER_REPLICAS" = "2"
2026-04-12 21:07:54.231736 I | op-k8sutil: operator setting "CSI_RBD_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-rbdplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-12 21:07:54.231742 I | op-k8sutil: operator setting "ROOK_CSI_DISABLE_DRIVER" = "false"
2026-04-12 21:07:54.231753 I | op-k8sutil: operator setting "ROOK_CSI_RESIZER_IMAGE" = "registry.k8s.io/sig-storage/csi-resizer:v1.11.1"
2026-04-12 21:07:54.231762 I | op-k8sutil: operator setting "CSI_CEPHFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-cephfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-12 21:07:54.231770 I | op-k8sutil: operator setting "CSI_DISABLE_HOLDER_PODS" = "true"
2026-04-12 21:07:54.231785 I | op-k8sutil: operator setting "CSI_RBD_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-resizer\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-snapshotter\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-rbdplugin\n  resource:\n    requests:\n      memory: 512Mi\n    limits:\n      memory: 1Gi\n- name : csi-omap-generator\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-12 21:07:54.231795 I | op-k8sutil: operator setting "ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS" = "15"
2026-04-12 21:07:54.231799 I | op-k8sutil: operator setting "ROOK_ENABLE_DISCOVERY_DAEMON" = "false"
2026-04-12 21:07:54.231804 I | op-k8sutil: operator setting "CSI_NFS_ATTACH_REQUIRED" = "true"
2026-04-12 21:07:54.231813 I | op-k8sutil: operator setting "CSI_NFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-nfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n"
2026-04-12 21:07:54.231823 I | op-k8sutil: operator setting "CSI_CEPHFS_ATTACH_REQUIRED" = "true"
2026-04-12 21:07:54.231828 I | op-k8sutil: operator setting "CSI_CEPHFS_FSGROUPPOLICY" = "File"
2026-04-12 21:07:54.231832 I | op-k8sutil: operator setting "CSI_ENABLE_ENCRYPTION" = "false"
2026-04-12 21:07:54.231837 I | op-k8sutil: operator setting "CSI_ENABLE_VOLUME_GROUP_SNAPSHOT" = "true"
2026-04-12 21:07:54.231840 I | op-k8sutil: operator setting "CSI_FORCE_CEPHFS_KERNEL_CLIENT" = "true"
2026-04-12 21:07:54.231845 I | op-k8sutil: operator setting "CSI_GRPC_TIMEOUT_SECONDS" = "150"
2026-04-12 21:07:54.231849 I | op-k8sutil: operator setting "ROOK_OBC_WATCH_OPERATOR_NAMESPACE" = "true"
2026-04-12 21:07:54.231856 I | operator: watching all namespaces for Ceph CRs
2026-04-12 21:07:54.231942 I | operator: setting up schemes
2026-04-12 21:07:54.234662 I | operator: setting up the controller-runtime manager
2026-04-12 21:07:54.235106 I | ceph-cluster-controller: successfully started
2026-04-12 21:07:54.235492 I | ceph-cluster-controller: enabling hotplug orchestration
2026-04-12 21:07:54.235517 I | ceph-nodedaemon-controller: successfully started
2026-04-12 21:07:54.235530 I | ceph-block-pool-controller: successfully started
2026-04-12 21:07:54.235543 I | ceph-object-store-user-controller: successfully started
2026-04-12 21:07:54.235563 I | ceph-object-realm-controller: successfully started
2026-04-12 21:07:54.235571 I | ceph-object-zonegroup-controller: successfully started
2026-04-12 21:07:54.235580 I | ceph-object-zone-controller: successfully started
2026-04-12 21:07:54.235652 I | ceph-object-controller: successfully started
2026-04-12 21:07:54.235685 I | ceph-file-controller: successfully started
2026-04-12 21:07:54.235704 I | ceph-nfs-controller: successfully started
2026-04-12 21:07:54.235732 I | ceph-rbd-mirror-controller: successfully started
2026-04-12 21:07:54.235756 I | ceph-client-controller: successfully started
2026-04-12 21:07:54.235774 I | ceph-filesystem-mirror-controller: successfully started
2026-04-12 21:07:54.235796 I | operator: rook-ceph-operator-config-controller successfully started
2026-04-12 21:07:54.235810 I | ceph-csi: rook-ceph-operator-csi-controller successfully started
2026-04-12 21:07:54.235950 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started
2026-04-12 21:07:54.235967 I | ceph-bucket-topic: successfully started
2026-04-12 21:07:54.235976 I | ceph-bucket-notification: successfully started
2026-04-12 21:07:54.235983 I | ceph-bucket-notification: successfully started
2026-04-12 21:07:54.235991 I | ceph-fs-subvolumegroup-controller: successfully started
2026-04-12 21:07:54.236036 I | blockpool-rados-namespace-controller: successfully started
2026-04-12 21:07:54.236086 I | ceph-cosi-controller: successfully started
2026-04-12 21:07:54.236105 I | operator: starting the controller-runtime manager
2026-04-12 21:07:54.459788 I | operator: rook-ceph-operator-config-controller done reconciling
2026-04-12 21:07:54.480531 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config"
2026-04-12 21:07:54.483926 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-04-12 21:07:54.486787 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-04-12 21:07:54.494738 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-04-12 21:07:54.494760 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-04-12 21:07:54.497213 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-04-12 21:07:54.503354 I | ceph-csi: successfully removed CSI CephFS driver
2026-04-12 21:07:54.503365 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-04-12 21:07:54.505198 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-04-12 21:07:54.511536 I | ceph-csi: successfully removed CSI NFS driver
2026-04-12 21:08:17.033437 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph"
2026-04-12 21:08:17.040735 I | clusterdisruption-controller: deleted all legacy node drain canary pods
2026-04-12 21:08:17.047424 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph"
2026-04-12 21:08:17.056929 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-12 21:08:17.056969 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-12 21:08:17.057149 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket"
2026-04-12 21:08:17.057755 I | op-bucket-prov: successfully reconciled bucket provisioner
I0412 21:08:17.057941       1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket"
2026-04-12 21:08:17.058974 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack"
2026-04-12 21:08:17.070843 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-04-12 21:08:17.059044585 +0000 UTC m=+23.004091414 LastTransitionTime:2026-04-12 21:08:17.059044525 +0000 UTC m=+23.004091354}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again
2026-04-12 21:08:17.079808 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-12 21:08:17.079844 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-12 21:08:17.079874 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc0016b5290]
2026-04-12 21:08:17.079891 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7...
2026-04-12 21:08:18.039482 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-12 21:08:18.039508 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-12 21:08:18.522264 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-04-12 21:08:18.525807 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-04-12 21:08:18.644628 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-04-12 21:08:18.644667 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-04-12 21:08:18.647656 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-04-12 21:08:18.843206 I | ceph-csi: successfully removed CSI CephFS driver
2026-04-12 21:08:18.843243 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-04-12 21:08:18.845616 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-04-12 21:08:19.044004 I | ceph-csi: successfully removed CSI NFS driver
2026-04-12 21:08:35.849292 I | ceph-spec: detected ceph image version: "18.2.7-0 reef"
2026-04-12 21:08:35.849329 I | ceph-cluster-controller: validating ceph version from provided image
2026-04-12 21:08:35.857929 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-12 21:08:35.857965 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-12 21:08:35.865924 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config
2026-04-12 21:08:35.866172 I | cephclient: generated admin config in /var/lib/rook/openstack
2026-04-12 21:08:36.347162 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 <unknown version>", consider upgrading
2026-04-12 21:08:36.818759 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7"
2026-04-12 21:08:38.009278 I | ceph-cluster-controller: creating "rook-config-override" configmap
2026-04-12 21:08:38.019862 I | ceph-cluster-controller: creating "rook-ceph-config" secret
2026-04-12 21:08:38.176615 I | ceph-cluster-controller: external cluster identity established
2026-04-12 21:08:38.176645 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner"
2026-04-12 21:08:38.271207 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings
2026-04-12 21:08:38.271251 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd
2026-04-12 21:08:38.289770 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:08:39.326948 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:08:39.387457 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node"
2026-04-12 21:08:40.469076 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:08:40.622152 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner"
2026-04-12 21:08:41.152093 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node"
2026-04-12 21:08:41.715689 I | ceph-csi: created kubernetes csi secrets for cluster "openstack"
2026-04-12 21:08:41.726293 I | ceph-cluster-controller: successfully updated csi config map
2026-04-12 21:08:41.726318 I | cephclient: getting or creating ceph auth key "client.crash"
2026-04-12 21:08:42.248316 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack"
2026-04-12 21:08:42.291181 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack"
2026-04-12 21:08:42.291222 I | ceph-cluster-controller: ceph status check interval is 1m0s
2026-04-12 21:08:42.291227 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack"
2026-04-12 21:08:48.039312 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-12 21:08:48.039337 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-12 21:08:48.039350 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7...
2026-04-12 21:08:50.004576 I | ceph-spec: detected ceph image version: "18.2.7-0 reef"
2026-04-12 21:08:51.300290 I | ceph-object-controller: reconciling object store deployments
2026-04-12 21:08:51.326817 I | ceph-object-controller: ceph object store gateway service running at 10.107.220.202
2026-04-12 21:08:51.326867 I | ceph-object-controller: reconciling object store pools
2026-04-12 21:08:54.685444 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded
2026-04-12 21:08:54.685473 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control"
2026-04-12 21:08:58.746957 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded
2026-04-12 21:08:58.746986 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta"
2026-04-12 21:09:02.853295 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded
2026-04-12 21:09:02.853326 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log"
2026-04-12 21:09:06.918137 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded
2026-04-12 21:09:06.918167 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index"
2026-04-12 21:09:08.840312 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:49} {StateName:unknown Count:8}]"
2026-04-12 21:09:08.844135 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:09:10.276406 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:09:12.021092 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded
2026-04-12 21:09:12.021130 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec"
2026-04-12 21:09:16.063523 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded
2026-04-12 21:09:16.063560 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp"
2026-04-12 21:09:20.143238 I | cephclient: reconciling replicated pool .rgw.root succeeded
2026-04-12 21:09:20.143284 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root"
2026-04-12 21:09:24.216545 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded
2026-04-12 21:09:24.216583 I | ceph-object-controller: configuring object store "ceph"
2026-04-12 21:09:24.961055 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph
2026-04-12 21:09:25.152245 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph"
2026-04-12 21:09:25.682620 I | ceph-object-controller: configuration for object-store ceph is complete
2026-04-12 21:09:25.687100 I | ceph-object-controller: creating object store "ceph" in namespace "openstack"
2026-04-12 21:09:25.692947 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a"
2026-04-12 21:09:26.202643 I | ceph-object-controller: setting rgw config flags
2026-04-12 21:09:26.202668 I | ceph-object-controller: Configuring authentication with keystone
2026-04-12 21:09:26.202688 I | op-config: setting option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:26.624488 I | op-config: successfully set option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:26.624533 I | op-config: setting option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:27.022959 I | op-config: successfully set option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:27.023002 I | op-config: setting option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:27.473605 I | op-config: successfully set option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:27.473647 I | op-config: setting option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:28.370274 I | op-config: successfully set option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:28.370308 I | op-config: setting option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:29.245026 I | op-config: successfully set option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:29.245107 I | op-config: setting option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:29.345595 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:09:29.712822 I | op-config: successfully set option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:29.712851 I | op-config: setting option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:30.117519 I | op-config: successfully set option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:30.117557 I | op-config: setting option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:30.522650 I | op-config: successfully set option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:30.522688 I | op-config: setting option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:30.932826 I | op-config: successfully set option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:30.932864 I | op-config: setting option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:31.332427 I | op-config: successfully set option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:31.332469 I | op-config: setting option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:31.757520 I | op-config: successfully set option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:31.757560 I | op-config: setting option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:32.191421 I | op-config: successfully set option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:32.191467 I | op-config: setting option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:32.635963 I | op-config: successfully set option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:32.635993 I | op-config: setting option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:33.041128 I | op-config: successfully set option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:33.041163 I | op-config: setting option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:33.486786 I | op-config: successfully set option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:33.486819 I | op-config: setting option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:33.884642 I | op-config: successfully set option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:33.884687 I | op-config: setting option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:34.313008 I | op-config: successfully set option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-12 21:09:34.313716 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created
2026-04-12 21:09:34.356168 I | ceph-object-controller: enabling rgw dashboard
2026-04-12 21:09:38.002446 I | ceph-object-controller: created object store "ceph" in namespace "openstack"
2026-04-12 21:09:38.003053 I | ceph-object-controller: setting the dashboard api secret key
2026-04-12 21:09:38.850885 I | ceph-object-controller: done setting the dashboard api secret key
2026-04-12 21:09:38.990085 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:09:39.496284 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:09:40.764732 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:10:09.456383 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:10:11.240369 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:109} {StateName:peering Count:1} {StateName:active+clean+scrubbing Count:1}]"
2026-04-12 21:10:11.244874 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:10:15.367942 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:10:39.960387 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:107} {StateName:peering Count:1}]"
2026-04-12 21:10:39.964875 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:10:41.740905 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:107} {StateName:peering Count:1}]"
2026-04-12 21:10:41.747212 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:11:01.352318 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:11:10.480135 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:100} {StateName:peering Count:2}]"
2026-04-12 21:11:10.484347 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:11:12.244459 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:100} {StateName:peering Count:2}]"
2026-04-12 21:11:12.249052 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:11:40.981641 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:103} {StateName:peering Count:2}]"
2026-04-12 21:11:40.986869 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:11:42.730845 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:103} {StateName:peering Count:1}]"
2026-04-12 21:11:42.737706 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:11:47.337915 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:12:11.474295 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:12:13.219754 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:12:33.316305 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:12:41.944004 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:12:43.714506 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:13:12.440567 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:13:14.222244 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:13:19.286669 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:13:42.934312 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:13:44.689958 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:14:05.285324 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:14:13.418777 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:14:15.154203 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:14:43.901452 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:14:45.641323 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:14:51.261230 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:15:14.398436 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:15:16.136089 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:15:37.210814 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:15:44.874059 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:15:46.602445 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:16:15.349746 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:16:17.073131 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:16:23.156570 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:16:45.828502 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:16:47.548721 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:17:09.107065 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:17:16.287490 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:17:18.012850 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:17:46.750293 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:17:48.476903 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:17:55.039789 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:18:17.209804 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:18:18.928146 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:18:41.027541 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:18:47.675605 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:18:49.381480 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:19:18.156772 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:19:19.851140 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:19:26.980778 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:19:48.620930 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:19:50.313044 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:20:12.910283 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:20:19.094139 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:20:20.768728 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:20:49.564982 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:20:51.230471 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:20:58.877838 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-12 21:21:20.050827 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-12 21:21:21.690411 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0