2026/08/19 09:30:50 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota 2026-08-19 09:30:50.570235 I | rookcmd: starting Rook v1.14.2 with arguments '/usr/local/bin/rook ceph operator' 2026-08-19 09:30:50.570257 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO 2026-08-19 09:30:50.570259 I | cephcmd: starting Rook-Ceph operator 2026-08-19 09:30:50.685135 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)" 2026-08-19 09:30:50.692792 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="false" (env var) 2026-08-19 09:30:50.692813 I | operator: watching all namespaces for Ceph CRs 2026-08-19 09:30:50.692904 I | operator: setting up schemes 2026-08-19 09:30:50.695939 I | operator: setting up the controller-runtime manager 2026-08-19 09:30:50.696377 I | ceph-cluster-controller: successfully started 2026-08-19 09:30:50.698752 I | op-k8sutil: ROOK_DISABLE_DEVICE_HOTPLUG="false" (env var) 2026-08-19 09:30:50.698811 I | ceph-cluster-controller: enabling hotplug orchestration 2026-08-19 09:30:50.698845 I | ceph-nodedaemon-controller: successfully started 2026-08-19 09:30:50.698872 I | ceph-block-pool-controller: successfully started 2026-08-19 09:30:50.698926 I | ceph-object-store-user-controller: successfully started 2026-08-19 09:30:50.698960 I | ceph-object-realm-controller: successfully started 2026-08-19 09:30:50.699001 I | ceph-object-zonegroup-controller: successfully started 2026-08-19 09:30:50.699033 I | ceph-object-zone-controller: successfully started 2026-08-19 09:30:50.699134 I | ceph-object-controller: successfully started 2026-08-19 09:30:50.699197 I | ceph-file-controller: successfully started 2026-08-19 09:30:50.699234 I | ceph-nfs-controller: successfully started 2026-08-19 09:30:50.699299 I | ceph-rbd-mirror-controller: successfully started 2026-08-19 09:30:50.699349 I | ceph-client-controller: successfully started 2026-08-19 09:30:50.699390 I | ceph-filesystem-mirror-controller: successfully started 2026-08-19 09:30:50.699431 I | operator: rook-ceph-operator-config-controller successfully started 2026-08-19 09:30:50.699477 I | ceph-csi: rook-ceph-operator-csi-controller successfully started 2026-08-19 09:30:50.699576 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started 2026-08-19 09:30:50.699617 I | ceph-bucket-topic: successfully started 2026-08-19 09:30:50.699645 I | ceph-bucket-notification: successfully started 2026-08-19 09:30:50.699670 I | ceph-bucket-notification: successfully started 2026-08-19 09:30:50.699725 I | ceph-fs-subvolumegroup-controller: successfully started 2026-08-19 09:30:50.699754 I | blockpool-rados-namespace-controller: successfully started 2026-08-19 09:30:50.699792 I | ceph-cosi-controller: successfully started 2026-08-19 09:30:50.699840 I | operator: starting the controller-runtime manager 2026-08-19 09:30:50.828859 I | op-k8sutil: ROOK_WATCH_FOR_NODE_FAILURE="true" (default) 2026-08-19 09:30:50.907150 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (configmap) 2026-08-19 09:30:50.907182 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (configmap) 2026-08-19 09:30:50.907202 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (configmap) 2026-08-19 09:30:50.907585 I | op-k8sutil: ROOK_CSI_DISABLE_DRIVER="false" (configmap) 2026-08-19 09:30:50.909079 I | ceph-csi: CSI Ceph RBD driver disabled 2026-08-19 09:30:50.909103 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-08-19 09:30:50.911163 I | op-k8sutil: ROOK_CEPH_ALLOW_LOOP_DEVICES="false" (configmap) 2026-08-19 09:30:50.911184 I | operator: rook-ceph-operator-config-controller done reconciling 2026-08-19 09:30:50.912594 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-08-19 09:30:50.921075 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-08-19 09:30:50.921096 I | ceph-csi: CSI CephFS driver disabled 2026-08-19 09:30:50.921105 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-08-19 09:30:50.923906 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-08-19 09:30:50.930977 I | ceph-csi: successfully removed CSI CephFS driver 2026-08-19 09:30:50.930996 I | ceph-csi: CSI NFS driver disabled 2026-08-19 09:30:50.931004 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-08-19 09:30:50.933443 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-08-19 09:30:50.939665 I | ceph-csi: successfully removed CSI NFS driver 2026-08-19 09:31:11.860741 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph" 2026-08-19 09:31:11.864963 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph" 2026-08-19 09:31:11.867337 I | clusterdisruption-controller: deleted all legacy node drain canary pods 2026-08-19 09:31:11.874366 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-08-19 09:31:11.874399 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-08-19 09:31:11.874559 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (configmap) 2026-08-19 09:31:11.874575 I | op-k8sutil: ROOK_OBC_PROVISIONER_NAME_PREFIX="" (default) 2026-08-19 09:31:11.874583 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket" 2026-08-19 09:31:11.875129 I | op-bucket-prov: successfully reconciled bucket provisioner I0819 09:31:11.875286 1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket" 2026-08-19 09:31:11.878451 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack" 2026-08-19 09:31:11.882625 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" 2026-08-19 09:31:11.889080 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-08-19 09:31:11.878548008 +0000 UTC m=+21.342622281 LastTransitionTime:2026-08-19 09:31:11.878547908 +0000 UTC m=+21.342622191}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again 2026-08-19 09:31:11.901789 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-08-19 09:31:11.901806 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-08-19 09:31:11.901825 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc00105cf30] 2026-08-19 09:31:11.901902 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1... 2026-08-19 09:31:11.903925 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (configmap) 2026-08-19 09:31:11.903936 I | op-k8sutil: CSI_DISABLE_HOLDER_PODS="true" (configmap) 2026-08-19 09:31:12.463105 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-08-19 09:31:12.463136 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-08-19 09:31:12.663583 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="false" (configmap) 2026-08-19 09:31:12.663611 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="false" (configmap) 2026-08-19 09:31:12.663618 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (configmap) 2026-08-19 09:31:12.663625 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="false" (default) 2026-08-19 09:31:12.663633 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (configmap) 2026-08-19 09:31:12.663640 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (configmap) 2026-08-19 09:31:12.663647 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) 2026-08-19 09:31:12.663655 I | op-k8sutil: CSIADDONS_PORT="9070" (default) 2026-08-19 09:31:12.663662 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) 2026-08-19 09:31:12.663670 I | op-k8sutil: CSI_ENABLE_LIVENESS="false" (default) 2026-08-19 09:31:12.663682 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="system-node-critical" (configmap) 2026-08-19 09:31:12.663690 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="system-cluster-critical" (configmap) 2026-08-19 09:31:12.663700 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (configmap) 2026-08-19 09:31:12.663713 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (configmap) 2026-08-19 09:31:12.663728 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (configmap) 2026-08-19 09:31:12.663735 I | op-k8sutil: CSI_ENABLE_NFS_SNAPSHOTTER="true" (configmap) 2026-08-19 09:31:12.665851 I | op-k8sutil: CSI_ENABLE_CSIADDONS="false" (configmap) 2026-08-19 09:31:12.665871 I | op-k8sutil: CSI_ENABLE_TOPOLOGY="false" (configmap) 2026-08-19 09:31:12.665879 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (configmap) 2026-08-19 09:31:12.665888 I | op-k8sutil: CSI_ENABLE_METADATA="false" (configmap) 2026-08-19 09:31:12.665902 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-08-19 09:31:12.665909 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-08-19 09:31:12.665921 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-08-19 09:31:12.665929 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) 2026-08-19 09:31:12.665936 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY_MAX_UNAVAILABLE="1" (default) 2026-08-19 09:31:12.665944 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (configmap) 2026-08-19 09:31:12.665954 I | ceph-csi: Kubernetes version is 1.28 2026-08-19 09:31:12.665961 I | op-k8sutil: CSI_LOG_LEVEL="" (default) 2026-08-19 09:31:12.665969 I | op-k8sutil: CSI_SIDECAR_LOG_LEVEL="" (default) 2026-08-19 09:31:12.665980 I | op-k8sutil: CSI_LEADER_ELECTION_LEASE_DURATION="" (default) 2026-08-19 09:31:12.665989 I | op-k8sutil: CSI_LEADER_ELECTION_RENEW_DEADLINE="" (default) 2026-08-19 09:31:12.665995 I | op-k8sutil: CSI_LEADER_ELECTION_RETRY_PERIOD="" (default) 2026-08-19 09:31:12.865770 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="quay.io/cephcsi/cephcsi:v3.11.0" (configmap) 2026-08-19 09:31:12.865799 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.10.0" (configmap) 2026-08-19 09:31:12.865808 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.k8s.io/sig-storage/csi-provisioner:v4.0.0" (configmap) 2026-08-19 09:31:12.865815 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.k8s.io/sig-storage/csi-attacher:v4.5.0" (configmap) 2026-08-19 09:31:12.865823 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.k8s.io/sig-storage/csi-snapshotter:v7.0.1" (configmap) 2026-08-19 09:31:12.865835 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.k8s.io/sig-storage/csi-resizer:v1.10.0" (configmap) 2026-08-19 09:31:12.865844 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) 2026-08-19 09:31:12.865852 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="quay.io/csiaddons/k8s-sidecar:v0.8.0" (configmap) 2026-08-19 09:31:12.865860 I | op-k8sutil: CSI_TOPOLOGY_DOMAIN_LABELS="" (default) 2026-08-19 09:31:12.865869 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) 2026-08-19 09:31:12.865876 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) 2026-08-19 09:31:12.865884 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) 2026-08-19 09:31:12.865890 I | op-k8sutil: CSI_CLUSTER_NAME="" (default) 2026-08-19 09:31:12.865897 I | op-k8sutil: ROOK_CSI_IMAGE_PULL_POLICY="IfNotPresent" (configmap) 2026-08-19 09:31:12.865903 I | op-k8sutil: CSI_CEPHFS_KERNEL_MOUNT_OPTIONS="" (default) 2026-08-19 09:31:12.865910 I | op-k8sutil: CSI_CEPHFS_ATTACH_REQUIRED="true" (configmap) 2026-08-19 09:31:12.865917 I | op-k8sutil: CSI_RBD_ATTACH_REQUIRED="true" (configmap) 2026-08-19 09:31:12.865923 I | op-k8sutil: CSI_NFS_ATTACH_REQUIRED="true" (configmap) 2026-08-19 09:31:12.865930 I | op-k8sutil: CSI_DRIVER_NAME_PREFIX="rook-ceph" (default) 2026-08-19 09:31:12.895326 I | op-k8sutil: CSI_ENABLE_VOLUME_GROUP_SNAPSHOT="true" (configmap) 2026-08-19 09:31:12.895345 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled 2026-08-19 09:31:12.895353 I | ceph-csi: CSI Ceph RBD driver disabled 2026-08-19 09:31:12.895359 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists 2026-08-19 09:31:12.898096 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists 2026-08-19 09:31:13.067762 I | ceph-csi: successfully removed CSI Ceph RBD driver 2026-08-19 09:31:13.067791 I | ceph-csi: CSI CephFS driver disabled 2026-08-19 09:31:13.067801 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists 2026-08-19 09:31:13.070273 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists 2026-08-19 09:31:13.266943 I | ceph-csi: successfully removed CSI CephFS driver 2026-08-19 09:31:13.266974 I | ceph-csi: CSI NFS driver disabled 2026-08-19 09:31:13.266982 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists 2026-08-19 09:31:13.269293 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists 2026-08-19 09:31:13.466148 I | ceph-csi: successfully removed CSI NFS driver 2026-08-19 09:31:28.165947 I | ceph-spec: detected ceph image version: "18.2.1-0 reef" 2026-08-19 09:31:28.165975 I | ceph-cluster-controller: validating ceph version from provided image 2026-08-19 09:31:28.172860 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-08-19 09:31:28.172876 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-08-19 09:31:28.175149 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config 2026-08-19 09:31:28.175324 I | cephclient: generated admin config in /var/lib/rook/openstack 2026-08-19 09:31:28.765158 E | cephver: external cluster ceph version is a major version higher "18.2.8-0 reef" than the local cluster "0.0.0-0 ", consider upgrading 2026-08-19 09:31:29.310062 W | ceph-cluster-controller: image spec version 18.2.1-0 reef is lower than the running cluster version 18.2.8-0 reef, downgrading is not supported 2026-08-19 09:31:29.878724 I | ceph-cluster-controller: upgrading ceph cluster to "18.2.1-0 reef" 2026-08-19 09:31:29.878764 I | ceph-cluster-controller: cluster "openstack": version "18.2.1-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1" 2026-08-19 09:31:30.151278 I | ceph-cluster-controller: creating "rook-config-override" configmap 2026-08-19 09:31:30.441871 I | ceph-cluster-controller: creating "rook-ceph-config" secret 2026-08-19 09:31:30.476095 I | ceph-cluster-controller: external cluster identity established 2026-08-19 09:31:30.476120 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" 2026-08-19 09:31:31.298704 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" 2026-08-19 09:31:31.883668 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" 2026-08-19 09:31:32.854204 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" 2026-08-19 09:31:33.261564 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings 2026-08-19 09:31:33.261595 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd 2026-08-19 09:31:33.272141 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:31:34.169733 I | ceph-csi: created kubernetes csi secrets for cluster "openstack" 2026-08-19 09:31:34.178154 I | ceph-cluster-controller: successfully updated csi config map 2026-08-19 09:31:34.178176 I | cephclient: getting or creating ceph auth key "client.crash" 2026-08-19 09:31:34.389839 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:31:35.459529 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack" 2026-08-19 09:31:35.463636 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack" 2026-08-19 09:31:35.463675 I | ceph-cluster-controller: ceph status check interval is 1m0s 2026-08-19 09:31:35.463683 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack" 2026-08-19 09:31:35.562063 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:31:41.952924 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-08-19 09:31:41.952946 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-08-19 09:31:41.952958 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1... 2026-08-19 09:31:44.061482 I | ceph-spec: detected ceph image version: "18.2.1-0 reef" 2026-08-19 09:31:45.512418 I | ceph-object-controller: reconciling object store deployments 2026-08-19 09:31:45.531464 I | ceph-object-controller: ceph object store gateway service running at 10.101.68.0 2026-08-19 09:31:45.531515 I | ceph-object-controller: reconciling object store pools 2026-08-19 09:31:48.652521 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-08-19 09:31:49.567725 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.control" 2026-08-19 09:31:49.567762 I | cephclient: updating pool "ceph.rgw.control" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.control_osd" 2026-08-19 09:31:49.567769 I | cephclient: crush rule "ceph.rgw.control" will no longer be used by pool "ceph.rgw.control" 2026-08-19 09:31:51.711421 I | cephclient: Successfully updated pool "ceph.rgw.control" failure domain to "osd" 2026-08-19 09:31:51.711457 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-08-19 09:31:56.777131 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-08-19 09:31:57.655643 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.meta" 2026-08-19 09:31:57.655675 I | cephclient: updating pool "ceph.rgw.meta" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.meta_osd" 2026-08-19 09:31:57.655683 I | cephclient: crush rule "ceph.rgw.meta" will no longer be used by pool "ceph.rgw.meta" 2026-08-19 09:31:59.849482 I | cephclient: Successfully updated pool "ceph.rgw.meta" failure domain to "osd" 2026-08-19 09:31:59.849521 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-08-19 09:32:04.392134 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:41} {StateName:unknown Count:8}]" 2026-08-19 09:32:04.397393 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:32:04.918387 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-08-19 09:32:05.069525 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:41} {StateName:unknown Count:8}]" 2026-08-19 09:32:05.073999 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:32:05.922627 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.log" 2026-08-19 09:32:05.922659 I | cephclient: updating pool "ceph.rgw.log" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.log_osd" 2026-08-19 09:32:05.922667 I | cephclient: crush rule "ceph.rgw.log" will no longer be used by pool "ceph.rgw.log" 2026-08-19 09:32:07.974264 I | cephclient: Successfully updated pool "ceph.rgw.log" failure domain to "osd" 2026-08-19 09:32:07.974302 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-08-19 09:32:12.021602 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-08-19 09:32:12.903818 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.index" 2026-08-19 09:32:12.903853 I | cephclient: updating pool "ceph.rgw.buckets.index" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.index_osd" 2026-08-19 09:32:12.903860 I | cephclient: crush rule "ceph.rgw.buckets.index" will no longer be used by pool "ceph.rgw.buckets.index" 2026-08-19 09:32:15.094030 I | cephclient: Successfully updated pool "ceph.rgw.buckets.index" failure domain to "osd" 2026-08-19 09:32:15.094060 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-08-19 09:32:19.165144 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-08-19 09:32:20.076586 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.non-ec" 2026-08-19 09:32:20.076634 I | cephclient: updating pool "ceph.rgw.buckets.non-ec" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.non-ec_osd" 2026-08-19 09:32:20.076643 I | cephclient: crush rule "ceph.rgw.buckets.non-ec" will no longer be used by pool "ceph.rgw.buckets.non-ec" 2026-08-19 09:32:22.257532 I | cephclient: Successfully updated pool "ceph.rgw.buckets.non-ec" failure domain to "osd" 2026-08-19 09:32:22.257575 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-08-19 09:32:22.439305 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:32:26.280161 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-08-19 09:32:27.195183 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.otp" 2026-08-19 09:32:27.195222 I | cephclient: updating pool "ceph.rgw.otp" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.otp_osd" 2026-08-19 09:32:27.195228 I | cephclient: crush rule "ceph.rgw.otp" will no longer be used by pool "ceph.rgw.otp" 2026-08-19 09:32:29.313460 I | cephclient: Successfully updated pool "ceph.rgw.otp" failure domain to "osd" 2026-08-19 09:32:29.313510 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-08-19 09:32:33.410742 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-08-19 09:32:34.318513 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule ".rgw.root" 2026-08-19 09:32:34.318547 I | cephclient: updating pool ".rgw.root" failure domain from "osd" to "osd" with new crush rule ".rgw.root_osd" 2026-08-19 09:32:34.318554 I | cephclient: crush rule ".rgw.root" will no longer be used by pool ".rgw.root" 2026-08-19 09:32:35.381999 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:73} {StateName:unknown Count:8}]" 2026-08-19 09:32:35.386503 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:32:36.462452 I | cephclient: Successfully updated pool ".rgw.root" failure domain to "osd" 2026-08-19 09:32:36.462483 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-08-19 09:32:36.580179 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:76} {StateName:unknown Count:5}]" 2026-08-19 09:32:36.584504 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:32:41.855952 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-08-19 09:32:42.759193 I | cephclient: creating a new crush rule for changed deviceClass ("default"-->"") on crush rule "ceph.rgw.buckets.data" 2026-08-19 09:32:42.759246 I | cephclient: updating pool "ceph.rgw.buckets.data" failure domain from "osd" to "osd" with new crush rule "ceph.rgw.buckets.data_osd" 2026-08-19 09:32:42.759254 I | cephclient: crush rule "ceph.rgw.buckets.data" will no longer be used by pool "ceph.rgw.buckets.data" 2026-08-19 09:32:44.886981 I | cephclient: Successfully updated pool "ceph.rgw.buckets.data" failure domain to "osd" 2026-08-19 09:32:44.887011 I | ceph-object-controller: configuring object store "ceph" 2026-08-19 09:32:45.480847 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-08-19 09:32:45.654347 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph" 2026-08-19 09:32:46.022201 I | ceph-object-controller: configuration for object-store ceph is complete 2026-08-19 09:32:46.022226 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-08-19 09:32:46.026755 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-08-19 09:32:46.604774 I | ceph-object-controller: setting rgw config flags 2026-08-19 09:32:46.604810 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-08-19 09:32:47.073022 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-08-19 09:32:47.073059 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-08-19 09:32:47.523283 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-08-19 09:32:47.523321 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-08-19 09:32:47.976045 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-08-19 09:32:47.976085 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-08-19 09:32:48.463551 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-08-19 09:32:48.463576 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-08-19 09:32:48.941391 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-08-19 09:32:48.941488 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-08-19 09:32:49.398235 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-08-19 09:32:49.398529 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-08-19 09:32:49.444821 I | ceph-object-controller: enabling rgw dashboard 2026-08-19 09:32:51.496757 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-08-19 09:32:51.497399 I | ceph-object-controller: setting the dashboard api secret key 2026-08-19 09:32:52.088054 I | ceph-object-controller: done setting the dashboard api secret key 2026-08-19 09:33:05.947985 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:110} {StateName:clean+premerge+peered Count:2}]" 2026-08-19 09:33:05.952230 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:33:07.159609 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:110} {StateName:clean+premerge+peered Count:2}]" 2026-08-19 09:33:07.164213 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:33:08.553942 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:33:21.803679 E | ceph-object-controller: failed to reconcile CephObjectStore "openstack/ceph". failed to create object store deployments: failed to get COSI user "cosi": Get "http://rook-ceph-rgw-ceph.openstack.svc:80/admin/user?format=json&uid=cosi": dial tcp 10.101.68.0:80: i/o timeout 2026-08-19 09:33:21.822470 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789 2026-08-19 09:33:21.822502 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234 2026-08-19 09:33:21.822518 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1... 2026-08-19 09:33:22.359675 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:108} {StateName:peering Count:2}]" 2026-08-19 09:33:22.363212 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:33:22.923539 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:108} {StateName:peering Count:2}]" 2026-08-19 09:33:22.928989 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:33:24.059507 I | ceph-spec: detected ceph image version: "18.2.1-0 reef" 2026-08-19 09:33:25.608517 I | ceph-object-controller: reconciling object store deployments 2026-08-19 09:33:25.642958 I | ceph-object-controller: ceph object store gateway service running at 10.101.68.0 2026-08-19 09:33:25.642995 I | ceph-object-controller: reconciling object store pools 2026-08-19 09:33:27.017038 I | cephclient: application "rgw" is already set on pool "ceph.rgw.control" 2026-08-19 09:33:27.017083 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded 2026-08-19 09:33:27.954111 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control" 2026-08-19 09:33:30.360598 I | cephclient: application "rgw" is already set on pool "ceph.rgw.meta" 2026-08-19 09:33:30.360640 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded 2026-08-19 09:33:31.286426 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta" 2026-08-19 09:33:33.328354 I | cephclient: application "rgw" is already set on pool "ceph.rgw.log" 2026-08-19 09:33:33.328394 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded 2026-08-19 09:33:34.205881 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log" 2026-08-19 09:33:36.878324 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.index" 2026-08-19 09:33:36.878372 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded 2026-08-19 09:33:37.150142 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:106} {StateName:peering Count:1}]" 2026-08-19 09:33:37.154529 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:33:38.381282 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:105} {StateName:clean+premerge+peered Count:1}]" 2026-08-19 09:33:38.385138 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:33:38.641584 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index" 2026-08-19 09:33:41.603787 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.non-ec" 2026-08-19 09:33:41.603828 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded 2026-08-19 09:33:42.533137 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec" 2026-08-19 09:33:44.548148 I | cephclient: application "rgw" is already set on pool "ceph.rgw.otp" 2026-08-19 09:33:44.548188 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded 2026-08-19 09:33:45.464174 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp" 2026-08-19 09:33:47.602062 I | cephclient: application "rgw" is already set on pool ".rgw.root" 2026-08-19 09:33:47.602120 I | cephclient: reconciling replicated pool .rgw.root succeeded 2026-08-19 09:33:48.600498 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root" 2026-08-19 09:33:50.617006 I | cephclient: application "rgw" is already set on pool "ceph.rgw.buckets.data" 2026-08-19 09:33:50.617041 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded 2026-08-19 09:33:51.506080 I | ceph-object-controller: configuring object store "ceph" 2026-08-19 09:33:51.740158 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph 2026-08-19 09:33:51.908336 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openstack/ceph" 2026-08-19 09:33:51.908380 I | ceph-object-controller: configuration for object-store ceph is complete 2026-08-19 09:33:51.908390 I | ceph-object-controller: creating object store "ceph" in namespace "openstack" 2026-08-19 09:33:51.912802 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a" 2026-08-19 09:33:52.500302 I | ceph-object-controller: setting rgw config flags 2026-08-19 09:33:52.500348 I | op-config: setting "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-08-19 09:33:52.944695 I | op-config: successfully set "client.rgw.ceph.a"="rgw_run_sync_thread"="true" option to the mon configuration database 2026-08-19 09:33:52.944836 I | op-config: setting "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-08-19 09:33:53.397576 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database 2026-08-19 09:33:53.397691 I | op-config: setting "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-08-19 09:33:54.151028 I | op-config: successfully set "client.rgw.ceph.a"="rgw_log_object_name_utc"="true" option to the mon configuration database 2026-08-19 09:33:54.151074 I | op-config: setting "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-08-19 09:33:55.081877 I | op-config: successfully set "client.rgw.ceph.a"="rgw_enable_usage_log"="true" option to the mon configuration database 2026-08-19 09:33:55.082025 I | op-config: setting "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-08-19 09:33:55.992332 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:33:56.065158 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zone"="ceph" option to the mon configuration database 2026-08-19 09:33:56.065207 I | op-config: setting "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-08-19 09:33:56.528920 I | op-config: successfully set "client.rgw.ceph.a"="rgw_zonegroup"="ceph" option to the mon configuration database 2026-08-19 09:33:56.529297 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created 2026-08-19 09:33:56.544438 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" already exists. updating if needed 2026-08-19 09:33:56.551835 I | op-k8sutil: deployment "rook-ceph-rgw-ceph-a" did not change, nothing to update 2026-08-19 09:33:56.555014 I | ceph-object-controller: config map "rook-ceph-rgw-ceph-mime-types" for object store "ceph" already exists, not overwriting 2026-08-19 09:33:56.559334 I | ceph-object-controller: enabling rgw dashboard 2026-08-19 09:33:57.650637 I | ceph-object-controller: created object store "ceph" in namespace "openstack" 2026-08-19 09:33:59.530049 I | ceph-object-controller: creating COSI user "cosi" 2026-08-19 09:33:59.615895 I | ceph-spec: created ceph *v1.Secret object "rook-ceph-object-user-ceph-cosi" 2026-08-19 09:34:00.211147 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:102} {StateName:clean+premerge+peered Count:1}]" 2026-08-19 09:34:00.215206 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:34:07.717978 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:103} {StateName:unknown Count:5} {StateName:creating+peering Count:3}]" 2026-08-19 09:34:07.724048 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:34:08.939470 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:101} {StateName:creating+peering Count:5} {StateName:unknown Count:3} {StateName:clean+premerge+peered Count:1}]" 2026-08-19 09:34:08.944020 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:34:38.292609 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:104} {StateName:peering Count:1}]" 2026-08-19 09:34:38.296943 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:34:39.501281 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:104} {StateName:peering Count:1}]" 2026-08-19 09:34:39.505260 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:34:42.845408 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:35:08.866754 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:35:10.051869 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:122} {StateName:active+recovery_wait+degraded Count:2} {StateName:active+recovering Count:1}]" 2026-08-19 09:35:10.055253 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:35:28.996336 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:35:39.431565 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:35:40.613985 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:36:10.010604 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:36:11.213899 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:36:15.218213 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:36:40.579037 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:36:41.804039 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:37:01.328389 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:37:11.159307 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:37:12.370646 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:37:41.724631 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:124} {StateName:unknown Count:5}]" 2026-08-19 09:37:41.728682 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:37:42.949292 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:37:47.512975 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:38:12.285936 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:38:13.523661 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:38:33.617299 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:38:42.869643 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:38:44.110439 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:39:13.418699 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:39:14.680766 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:39:19.767070 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:39:44.012545 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:39:45.301936 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:40:05.961773 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:40:14.600973 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:40:15.852200 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:40:45.201357 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:40:46.390710 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:40:52.118152 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:41:15.750820 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:41:16.963170 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:41:38.268152 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:41:46.311973 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:41:47.539521 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:42:16.880985 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:42:18.112888 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:42:24.444666 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:42:47.484265 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:42:48.702284 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:43:10.606317 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:43:18.046727 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:43:19.272107 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:43:48.626159 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:43:49.832375 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:43:56.759084 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:44:19.182428 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:44:20.385651 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:44:42.915677 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:44:49.758586 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:44:50.953569 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:45:20.354546 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:45:21.536485 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:45:29.063813 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:45:50.961881 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:45:52.098455 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:46:15.187845 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:46:21.551775 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:46:22.790037 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:46:52.134414 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:46:53.362763 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:47:01.355536 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:47:22.708972 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:47:23.939781 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:47:47.488058 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:47:53.275182 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:47:54.517762 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:48:23.833468 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:48:25.086950 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:48:33.684268 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:48:54.397255 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:48:55.637577 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:49:19.779990 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:49:25.032020 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:49:26.193982 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:49:55.595881 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:49:56.764992 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:50:05.902721 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:50:26.220945 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:50:27.312108 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:50:52.044262 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:50:56.789158 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:50:57.874239 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:51:27.323486 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:51:28.452793 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:51:38.213329 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:51:58.004335 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:51:59.124632 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:52:24.418801 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:52:28.592062 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:52:29.705216 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:52:59.197081 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:53:00.348438 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:53:10.604361 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:53:29.757447 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:53:30.938019 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:53:56.847639 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:54:00.316094 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:54:01.505922 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:54:30.898993 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:54:32.069249 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:54:42.988824 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:55:01.496958 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:55:02.638156 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:55:29.167660 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:55:32.085545 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:55:33.251263 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:56:02.694699 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:56:03.871409 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:56:15.366618 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:56:33.269084 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:56:34.454232 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:57:01.545087 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:57:04.124462 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:57:05.398105 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:57:34.740053 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:57:36.014798 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:57:47.742545 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:58:05.321714 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:58:06.581383 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:58:33.901810 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:58:35.933718 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:58:37.188802 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:59:06.516846 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:59:07.778599 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:59:20.082036 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 09:59:37.104102 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 09:59:38.343348 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:00:06.280166 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:00:07.657564 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:00:08.921687 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:00:38.274218 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:00:39.529204 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:00:52.476854 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:01:08.899955 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:01:10.123948 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:01:38.680413 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:01:39.484133 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:01:40.720364 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:02:10.065220 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:02:11.360545 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:02:24.895881 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:02:40.676747 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:02:41.957943 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:03:11.541078 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:03:11.761558 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:03:12.532685 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:03:42.365430 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:03:43.119642 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:03:57.723375 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:04:14.368182 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:04:15.403896 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:04:43.927704 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:04:44.926456 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:04:45.991319 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:05:15.526261 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:05:16.580922 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:05:30.150051 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:05:46.102572 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:05:47.169008 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:06:16.659113 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:06:16.971335 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:06:17.769460 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:06:47.556001 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:06:48.360160 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:07:02.850165 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:07:18.150305 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:07:19.015194 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:07:49.371335 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:07:50.193862 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:07:50.458328 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:08:20.011483 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:08:21.124030 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:08:36.431671 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:08:50.591625 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:08:51.725158 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:09:21.195489 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:09:22.946859 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:09:23.285679 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:09:51.783901 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:09:53.535587 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:10:09.509540 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:10:22.330364 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:10:24.143725 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:10:52.907764 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:10:54.985084 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:10:56.011788 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:11:23.509247 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:11:25.559753 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:11:42.203167 W | op-mon: external cluster mon count is 1, consider adding new monitors. 2026-08-19 10:11:54.146316 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0 2026-08-19 10:11:56.130927 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0