2026/03/31 18:46:13 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-03-31 18:46:13.647155 I | rookcmd: starting Rook v1.14.5 with arguments '/usr/local/bin/rook ceph operator' 2026-03-31 18:46:13.647177 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-03-31 18:46:13.647179 I | cephcmd: starting Rook-Ceph operator 2026-03-31 18:46:13.771920 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)" 2026-03-31 18:46:13.779546 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var) 2026-03-31 18:46:13.779570 I | operator: watching all namespaces for Ceph CRs 2026-03-31 18:46:13.779650 I | operator: setting up schemes 2026-03-31 18:46:13.782072 I | operator: setting up the controller-runtime manager 2026-03-31 18:46:13.782461 I | ceph-cluster-controller: successfully started 2026-03-31 18:46:13.785806 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var) 2026-03-31 18:46:13.785829 I | ceph-cluster-controller: enabling hotplug orchestration 2026-03-31 18:46:13.785857 I | ceph-nodedaemon-controller: successfully started 2026-03-31 18:46:13.785878 I | ceph-block-pool-controller: successfully started 2026-03-31 18:46:13.785906 I | ceph-object-store-user-controller: successfully started 2026-03-31 18:46:13.785924 I | ceph-object-realm-controller: successfully started 2026-03-31 18:46:13.785952 I | ceph-object-zonegroup-controller: successfully started 2026-03-31 18:46:13.785964 I | ceph-object-zone-controller: successfully started 2026-03-31 18:46:13.786116 I | ceph-object-controller: successfully started 2026-03-31 18:46:13.786160 I | ceph-file-controller: successfully started 2026-03-31 18:46:13.786190 I | ceph-nfs-controller: successfully started 2026-03-31 18:46:13.786226 I | ceph-rbd-mirror-controller: successfully started 2026-03-31 18:46:13.786266 I | ceph-client-controller: successfully started 2026-03-31 18:46:13.786290 I | ceph-filesystem-mirror-controller: successfully started 2026-03-31 18:46:13.786318 I | operator: rook-ceph-operator-config-controller successfully started 2026-03-31 18:46:13.786343 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-03-31 18:46:13.786465 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-03-31 18:46:13.786484 I | ceph-bucket-topic: successfully started 2026-03-31 18:46:13.786495 I | ceph-bucket-notification: successfully started 2026-03-31 18:46:13.786511 I | ceph-bucket-notification: successfully started 2026-03-31 18:46:13.786523 I | ceph-fs-subvolumegroup-controller: successfully started 2026-03-31 18:46:13.786539 I | blockpool-rados-namespace-controller: successfully started 2026-03-31 18:46:13.786555 I | ceph-cosi-controller: successfully started 2026-03-31 18:46:13.786584 I | operator: starting the controller-runtime manager 2026-03-31 18:46:13.927664 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default) 2026-03-31 18:46:14.025098 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap) 2026-03-31 18:46:14.025140 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap) 2026-03-31 18:46:14.025161 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap) 2026-03-31 18:46:14.029610 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap) 2026-03-31 18:46:14.029628 I | operator: rook-ceph-operator-config-controller done reconciling 2026-03-31 18:46:14.039618 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-03-31 18:46:14.039685 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap) 2026-03-31 18:46:14.040968 I | ceph-csi: CSI Ceph RBD driver disabled 2026-03-31 18:46:14.040991 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-03-31 18:46:14.043761 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-03-31 18:46:14.050449 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-03-31 18:46:14.050464 I | ceph-csi: CSI CephFS driver disabled 2026-03-31 18:46:14.050468 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-03-31 18:46:14.052258 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-03-31 18:46:14.060300 I | ceph-csi: successfully removed CSI CephFS driver 2026-03-31 18:46:14.060329 I | ceph-csi: CSI NFS driver disabled 2026-03-31 18:46:14.060348 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-03-31 18:46:14.062690 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-03-31 18:46:14.068566 I | ceph-csi: successfully removed CSI NFS driver 2026-03-31 18:46:35.550246 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-03-31 18:46:35.553982 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-03-31 18:46:35.555987 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-03-31 18:46:35.568734 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-31 18:46:35.568841 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-31 18:46:35.569023 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap) 2026-03-31 18:46:35.569077 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default) 2026-03-31 18:46:35.569104 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-03-31 18:46:35.569551 I | op-bucket-prov: successfully reconciled bucket provisioner I0331 18:46:35.569862 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-03-31 18:46:35.571793 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-03-31 18:46:35.589980 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap) 2026-03-31 18:46:35.589999 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap) 2026-03-31 18:46:35.754887 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-31 18:46:35.754912 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-31 18:46:35.754932 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001917440] 2026-03-31 18:46:35.754947 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-03-31 18:46:35.952992 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-31 18:46:35.953021 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-31 18:46:36.352950 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap) 2026-03-31 18:46:36.352985 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap) 2026-03-31 18:46:36.352993 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap) 2026-03-31 18:46:36.353001 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default) 2026-03-31 18:46:36.353009 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap) 2026-03-31 18:46:36.353017 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap) 2026-03-31 18:46:36.353025 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) 2026-03-31 18:46:36.353033 I | op-k8sutil: CSIADDONS_PORT="9070" (default) 2026-03-31 18:46:36.353043 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) 2026-03-31 18:46:36.353051 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default) 2026-03-31 18:46:36.353058 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap) 2026-03-31 18:46:36.353066 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap) 2026-03-31 18:46:36.353075 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap) 2026-03-31 18:46:36.353084 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap) 2026-03-31 18:46:36.353091 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap) 2026-03-31 18:46:36.353098 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap) 2026-03-31 18:46:36.354912 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap) 2026-03-31 18:46:36.354943 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap) 2026-03-31 18:46:36.354953 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap) 2026-03-31 18:46:36.354961 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap) 2026-03-31 18:46:36.354971 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-03-31 18:46:36.354980 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-03-31 18:46:36.354990 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-03-31 18:46:36.354999 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-03-31 18:46:36.355008 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-03-31 18:46:36.355017 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap) 2026-03-31 18:46:36.355030 I | ceph-csi: Kubernetes version is 1.28 2026-03-31 18:46:36.355038 I | op-k8sutil: CSI_LOG_LEVEL="" (default) 2026-03-31 18:46:36.355047 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default) 2026-03-31 18:46:36.355110 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default) 2026-03-31 18:46:36.355125 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default) 2026-03-31 18:46:36.355134 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default) 2026-03-31 18:46:36.755084 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap) 2026-03-31 18:46:36.755121 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.1" (configmap) 2026-03-31 18:46:36.755130 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.1" (configmap) 2026-03-31 18:46:36.755137 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.1" (configmap) 2026-03-31 18:46:36.755143 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.2" (configmap) 2026-03-31 18:46:36.755157 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.1" (configmap) 2026-03-31 18:46:36.755167 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) 2026-03-31 18:46:36.755175 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap) 2026-03-31 18:46:36.755183 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default) 2026-03-31 18:46:36.755196 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) 2026-03-31 18:46:36.755205 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) 2026-03-31 18:46:36.755210 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) 2026-03-31 18:46:36.755220 I | op-k8sutil: CSI_CLUSTER_NAME="" (default) 2026-03-31 18:46:36.755226 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap) 2026-03-31 18:46:36.755231 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default) 2026-03-31 18:46:36.755237 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap) 2026-03-31 18:46:36.755242 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap) 2026-03-31 18:46:36.755248 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap) 2026-03-31 18:46:36.755253 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default) 2026-03-31 18:46:36.757343 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap) 2026-03-31 18:46:36.757364 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled 2026-03-31 18:46:36.757369 I | ceph-csi: CSI Ceph RBD driver disabled 2026-03-31 18:46:36.757373 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-03-31 18:46:36.759892 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-03-31 18:46:36.956272 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-03-31 18:46:36.956299 I | ceph-csi: CSI CephFS driver disabled 2026-03-31 18:46:36.956306 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-03-31 18:46:36.958967 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-03-31 18:46:37.389205 I | ceph-csi: successfully removed CSI CephFS driver 2026-03-31 18:46:37.389244 I | ceph-csi: CSI NFS driver disabled 2026-03-31 18:46:37.389252 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-03-31 18:46:37.395467 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-03-31 18:46:37.401534 I | ceph-csi: successfully removed CSI NFS driver 2026-03-31 18:46:56.460595 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-03-31 18:46:56.460625 I | ceph-cluster-controller: validating ceph version from provided image 2026-03-31 18:46:56.465542 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-31 18:46:56.465570 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-31 18:46:56.468912 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-03-31 18:46:56.469045 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-03-31 18:46:57.020489 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-03-31 18:46:57.949711 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7" 2026-03-31 18:46:58.310695 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-03-31 18:46:58.444270 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-03-31 18:46:58.663508 I | ceph-cluster-controller: external cluster identity established 2026-03-31 18:46:58.663534 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-03-31 18:47:01.193779 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-03-31 18:47:01.995222 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-03-31 18:47:03.336120 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-03-31 18:47:05.772668 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-03-31 18:47:05.781275 I | ceph-cluster-controller: successfully updated csi config map 2026-03-31 18:47:05.781291 I | cephclient: getting or creating ceph auth key "client.crash" 2026-03-31 18:47:06.970803 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-03-31 18:47:06.973265 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-03-31 18:47:06.973301 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-03-31 18:47:06.973305 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-03-31 18:47:07.182039 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-03-31 18:47:07.182077 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-03-31 18:47:07.189441 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:47:08.504976 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:47:09.772967 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:47:15.703060 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-31 18:47:15.703085 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-31 18:47:15.703109 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-03-31 18:47:17.782580 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-03-31 18:47:19.321288 I | ceph-object-controller: reconciling object store deployments 2026-03-31 18:47:19.341676 I | ceph-object-controller: ceph object store gateway service running at 10.100.63.89 2026-03-31 18:47:19.341711 I | ceph-object-controller: reconciling object store pools 2026-03-31 18:47:22.245137 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-03-31 18:47:23.310064 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control" 2026-03-31 18:47:23.310120 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd" 2026-03-31 18:47:23.310130 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control" 2026-03-31 18:47:25.280209 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd" 2026-03-31 18:47:25.280235 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-03-31 18:47:29.340566 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-03-31 18:47:30.297537 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta" 2026-03-31 18:47:30.297572 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd" 2026-03-31 18:47:30.297578 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta" 2026-03-31 18:47:32.696389 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd" 2026-03-31 18:47:32.696424 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-03-31 18:47:36.868296 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-03-31 18:47:38.388248 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:41} {StateName:unknown Count:4} {StateName:creating+peering Count:4}]" 2026-03-31 18:47:38.392616 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:47:38.403215 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log" 2026-03-31 18:47:38.403255 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd" 2026-03-31 18:47:38.403260 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log" 2026-03-31 18:47:39.502132 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:41} {StateName:unknown Count:4} {StateName:creating+peering Count:4}]" 2026-03-31 18:47:39.508591 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:47:40.906035 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd" 2026-03-31 18:47:40.906070 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-03-31 18:47:44.995996 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-03-31 18:47:45.882896 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index" 2026-03-31 18:47:45.882930 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd" 2026-03-31 18:47:45.882938 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index" 2026-03-31 18:47:48.074871 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd" 2026-03-31 18:47:48.074896 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-03-31 18:47:52.171441 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-03-31 18:47:54.271778 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec" 2026-03-31 18:47:54.271803 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd" 2026-03-31 18:47:54.271809 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec" 2026-03-31 18:47:54.459146 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:47:56.190315 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd" 2026-03-31 18:47:56.190355 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-03-31 18:48:00.530448 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-03-31 18:48:01.436127 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp" 2026-03-31 18:48:01.436173 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd" 2026-03-31 18:48:01.436200 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp" 2026-03-31 18:48:03.672545 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd" 2026-03-31 18:48:03.672576 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-03-31 18:48:07.753513 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-03-31 18:48:08.972214 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root" 2026-03-31 18:48:08.972255 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd" 2026-03-31 18:48:08.972264 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root" 2026-03-31 18:48:09.671497 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:73} {StateName:unknown Count:7} {StateName:creating+peering Count:1}]" 2026-03-31 18:48:09.676086 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:48:11.702858 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:73} {StateName:unknown Count:7} {StateName:creating+peering Count:1}]" 2026-03-31 18:48:12.396996 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:48:14.967595 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd" 2026-03-31 18:48:14.967638 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-03-31 18:48:19.750397 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-03-31 18:48:20.682961 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data" 2026-03-31 18:48:20.683000 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd" 2026-03-31 18:48:20.683008 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data" 2026-03-31 18:48:22.799680 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd" 2026-03-31 18:48:22.799718 I | ceph-object-controller: configuring object store "ceph" 2026-03-31 18:48:23.444557 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-03-31 18:48:23.639606 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-03-31 18:48:24.045998 I | ceph-object-controller: configuration for object-store ceph is complete 2026-03-31 18:48:24.046056 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-03-31 18:48:24.050952 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-03-31 18:48:24.651557 I | ceph-object-controller: setting rgw config flags 2026-03-31 18:48:24.651609 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-03-31 18:48:25.135332 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-03-31 18:48:25.135385 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-03-31 18:48:25.621615 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-03-31 18:48:25.621656 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-03-31 18:48:26.090763 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-03-31 18:48:26.090805 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-03-31 18:48:26.594753 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-03-31 18:48:26.594783 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-03-31 18:48:27.061309 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-03-31 18:48:27.061351 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-03-31 18:48:27.545928 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-03-31 18:48:27.546204 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-03-31 18:48:27.585802 I | ceph-object-controller: enabling rgw dashboard 2026-03-31 18:48:29.796310 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-03-31 18:48:29.797172 I | ceph-object-controller: setting the dashboard api secret key 2026-03-31 18:48:30.445860 I | ceph-object-controller: done setting the dashboard api secret key 2026-03-31 18:48:41.077271 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:111} {StateName:peering Count:1}]" 2026-03-31 18:48:41.080638 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:48:41.401077 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:48:42.980889 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:111} {StateName:peering Count:1}]" 2026-03-31 18:48:42.987357 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:00.301859 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.100.63.89:80: i/o timeout 2026-03-31 18:49:00.367080 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-03-31 18:49:00.367113 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-03-31 18:49:00.367130 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7... 2026-03-31 18:49:00.915297 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:108} {StateName:clean+premerge+peered Count:1}]" 2026-03-31 18:49:00.919316 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:01.509969 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:106} {StateName:peering Count:2} {StateName:clean+premerge+peered Count:1}]" 2026-03-31 18:49:01.518773 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:02.865171 I | ceph-spec: detected ceph image version: "18.2.7-0 reef" 2026-03-31 18:49:04.387709 I | ceph-object-controller: reconciling object store deployments 2026-03-31 18:49:04.416348 I | ceph-object-controller: ceph object store gateway service running at 10.100.63.89 2026-03-31 18:49:04.416384 I | ceph-object-controller: reconciling object store pools 2026-03-31 18:49:05.820457 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control" 2026-03-31 18:49:05.820573 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-03-31 18:49:06.760849 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-03-31 18:49:08.955618 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta" 2026-03-31 18:49:08.955652 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-03-31 18:49:09.862703 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-03-31 18:49:12.306971 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:12.694184 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log" 2026-03-31 18:49:12.694218 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-03-31 18:49:14.278107 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:107} {StateName:peering Count:1}]" 2026-03-31 18:49:14.282404 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:14.468773 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-03-31 18:49:17.648855 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index" 2026-03-31 18:49:17.648892 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-03-31 18:49:18.583153 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-03-31 18:49:21.208728 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec" 2026-03-31 18:49:21.208752 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-03-31 18:49:22.111759 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-03-31 18:49:24.287149 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp" 2026-03-31 18:49:24.287184 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-03-31 18:49:25.272343 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-03-31 18:49:28.375380 I | cephclient: application "rgw" is already set on pool ".rgw.root" 2026-03-31 18:49:28.375412 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-03-31 18:49:28.963934 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:49:29.661982 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-03-31 18:49:32.440567 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data" 2026-03-31 18:49:32.440599 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-03-31 18:49:33.379784 I | ceph-object-controller: configuring object store "ceph" 2026-03-31 18:49:33.625845 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-03-31 18:49:33.827445 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph" 2026-03-31 18:49:33.827477 I | ceph-object-controller: configuration for object-store ceph is complete 2026-03-31 18:49:33.827510 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-03-31 18:49:33.832043 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-03-31 18:49:34.417231 I | ceph-object-controller: setting rgw config flags 2026-03-31 18:49:34.417259 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-03-31 18:49:34.895990 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-03-31 18:49:34.896040 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-03-31 18:49:35.365129 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-03-31 18:49:35.365167 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-03-31 18:49:35.812648 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-03-31 18:49:35.812688 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-03-31 18:49:36.252498 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-03-31 18:49:36.252537 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-03-31 18:49:36.726551 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-03-31 18:49:36.726579 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-03-31 18:49:37.189673 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-03-31 18:49:37.190141 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-03-31 18:49:37.207314 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed 2026-03-31 18:49:37.218433 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update 2026-03-31 18:49:37.222277 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting 2026-03-31 18:49:37.227549 I | ceph-object-controller: enabling rgw dashboard 2026-03-31 18:49:38.372743 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-03-31 18:49:39.342295 I | ceph-object-controller: creating COSI user "cosi" 2026-03-31 18:49:39.483735 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi" 2026-03-31 18:49:40.053112 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:42.899648 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:49:44.847471 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:50:13.556602 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:103} {StateName:clean+premerge+peered Count:1}]" 2026-03-31 18:50:13.559773 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:50:15.307331 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:50:15.693751 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:102} {StateName:peering Count:1}]" 2026-03-31 18:50:15.697337 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:50:44.135146 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:50:46.260965 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:51:01.441014 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:51:14.745485 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:51:16.827223 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:51:45.298401 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:51:48.083630 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:51:48.297332 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:52:15.861545 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:52:18.670834 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:52:34.468003 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:52:46.419886 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:52:49.248137 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:53:17.028122 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:53:20.376109 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:53:22.078113 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:53:47.607838 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:53:50.941938 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:54:08.244662 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:54:18.191262 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:54:21.547405 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:54:48.772323 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:54:52.154248 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:54:54.413627 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:55:19.383049 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:55:22.739930 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:55:40.554526 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:55:50.023847 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:55:53.368953 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:56:20.592119 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:56:23.957239 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:56:27.251718 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:56:51.159592 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:56:54.550340 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:57:13.448475 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-03-31 18:57:21.718315 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:57:25.130737 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:57:52.303780 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:57:55.718246 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-03-31 18:57:59.596010 W | op-mon: external cluster mon count is 1, consider adding new monitors.