2026/04/28 22:44:14 maxprocs: Updating GOMAXPROCS=1: determined from CPU quota
2026-04-28 22:44:14.982314 I | rookcmd: starting Rook v1.15.9 with arguments '/usr/local/bin/rook ceph operator'
2026-04-28 22:44:14.982340 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO
2026-04-28 22:44:14.982343 I | cephcmd: starting Rook-Ceph operator
2026-04-28 22:44:15.082327 I | cephcmd: base ceph version inside the rook operator image is "ceph version 18.2.4 (e7ad5345525c7aa95470c26863873b581076945d) reef (stable)"
2026-04-28 22:44:15.090435 I | op-k8sutil: operator setting "CSI_NFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-nfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n"
2026-04-28 22:44:15.090478 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_CEPHFS" = "false"
2026-04-28 22:44:15.090492 I | op-k8sutil: operator setting "ROOK_CSI_RESIZER_IMAGE" = "registry.k8s.io/sig-storage/csi-resizer:v1.11.1"
2026-04-28 22:44:15.090499 I | op-k8sutil: operator setting "ROOK_LOG_LEVEL" = "INFO"
2026-04-28 22:44:15.090506 I | op-k8sutil: operator setting "CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT" = "false"
2026-04-28 22:44:15.090513 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_RBD" = "false"
2026-04-28 22:44:15.090520 I | op-k8sutil: operator setting "ROOK_CSI_PROVISIONER_IMAGE" = "registry.k8s.io/sig-storage/csi-provisioner:v5.0.1"
2026-04-28 22:44:15.090529 I | op-k8sutil: operator setting "CSI_ENABLE_ENCRYPTION" = "false"
2026-04-28 22:44:15.090535 I | op-k8sutil: operator setting "CSI_ENABLE_TOPOLOGY" = "false"
2026-04-28 22:44:15.090553 I | op-k8sutil: operator setting "CSI_NFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-nfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n"
2026-04-28 22:44:15.090583 I | op-k8sutil: operator setting "CSI_RBD_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-resizer\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-snapshotter\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-rbdplugin\n  resource:\n    requests:\n      memory: 512Mi\n    limits:\n      memory: 1Gi\n- name : csi-omap-generator\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-28 22:44:15.090612 I | op-k8sutil: operator setting "ROOK_CEPH_ALLOW_LOOP_DEVICES" = "false"
2026-04-28 22:44:15.090619 I | op-k8sutil: operator setting "ROOK_CSI_ATTACHER_IMAGE" = "registry.k8s.io/sig-storage/csi-attacher:v4.6.1"
2026-04-28 22:44:15.090626 I | op-k8sutil: operator setting "ROOK_CSI_CEPH_IMAGE" = "quay.io/cephcsi/cephcsi:v3.12.3"
2026-04-28 22:44:15.090632 I | op-k8sutil: operator setting "ROOK_CSI_SNAPSHOTTER_IMAGE" = "registry.k8s.io/sig-storage/csi-snapshotter:v8.0.1"
2026-04-28 22:44:15.090638 I | op-k8sutil: operator setting "CSI_CEPHFS_ATTACH_REQUIRED" = "true"
2026-04-28 22:44:15.090644 I | op-k8sutil: operator setting "CSI_ENABLE_RBD_SNAPSHOTTER" = "true"
2026-04-28 22:44:15.090650 I | op-k8sutil: operator setting "CSI_RBD_FSGROUPPOLICY" = "File"
2026-04-28 22:44:15.090656 I | op-k8sutil: operator setting "ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS" = "15"
2026-04-28 22:44:15.090664 I | op-k8sutil: operator setting "ROOK_CSI_REGISTRAR_IMAGE" = "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.11.1"
2026-04-28 22:44:15.090670 I | op-k8sutil: operator setting "CSI_ENABLE_METADATA" = "false"
2026-04-28 22:44:15.090677 I | op-k8sutil: operator setting "CSI_PROVISIONER_PRIORITY_CLASSNAME" = "system-cluster-critical"
2026-04-28 22:44:15.090684 I | op-k8sutil: operator setting "ROOK_CSIADDONS_IMAGE" = "quay.io/csiaddons/k8s-sidecar:v0.9.1"
2026-04-28 22:44:15.090691 I | op-k8sutil: operator setting "ROOK_CSI_DISABLE_DRIVER" = "false"
2026-04-28 22:44:15.090700 I | op-k8sutil: operator setting "ROOK_CSI_IMAGE_PULL_POLICY" = "IfNotPresent"
2026-04-28 22:44:15.090725 I | op-k8sutil: operator setting "CSI_CEPHFS_PROVISIONER_RESOURCE" = "- name : csi-provisioner\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-resizer\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-attacher\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-snapshotter\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 100m\n    limits:\n      memory: 256Mi\n- name : csi-cephfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-28 22:44:15.090735 I | op-k8sutil: operator setting "CSI_ENABLE_CEPHFS_SNAPSHOTTER" = "true"
2026-04-28 22:44:15.090745 I | op-k8sutil: operator setting "CSI_ENABLE_NFS_SNAPSHOTTER" = "true"
2026-04-28 22:44:15.090761 I | op-k8sutil: operator setting "CSI_ENABLE_VOLUME_GROUP_SNAPSHOT" = "true"
2026-04-28 22:44:15.090774 I | op-k8sutil: operator setting "CSI_NFS_ATTACH_REQUIRED" = "true"
2026-04-28 22:44:15.090782 I | op-k8sutil: operator setting "CSI_PLUGIN_PRIORITY_CLASSNAME" = "system-node-critical"
2026-04-28 22:44:15.090795 I | op-k8sutil: operator setting "CSI_RBD_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-rbdplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-28 22:44:15.090809 I | op-k8sutil: operator setting "CSI_RBD_ATTACH_REQUIRED" = "true"
2026-04-28 22:44:15.090816 I | op-k8sutil: operator setting "CSI_CEPHFS_FSGROUPPOLICY" = "File"
2026-04-28 22:44:15.090831 I | op-k8sutil: operator setting "CSI_CEPHFS_PLUGIN_RESOURCE" = "- name : driver-registrar\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n- name : csi-cephfsplugin\n  resource:\n    requests:\n      memory: 512Mi\n      cpu: 250m\n    limits:\n      memory: 1Gi\n- name : liveness-prometheus\n  resource:\n    requests:\n      memory: 128Mi\n      cpu: 50m\n    limits:\n      memory: 256Mi\n"
2026-04-28 22:44:15.090845 I | op-k8sutil: operator setting "CSI_ENABLE_OMAP_GENERATOR" = "false"
2026-04-28 22:44:15.090854 I | op-k8sutil: operator setting "CSI_FORCE_CEPHFS_KERNEL_CLIENT" = "true"
2026-04-28 22:44:15.090860 I | op-k8sutil: operator setting "CSI_GRPC_TIMEOUT_SECONDS" = "150"
2026-04-28 22:44:15.090866 I | op-k8sutil: operator setting "CSI_NFS_FSGROUPPOLICY" = "File"
2026-04-28 22:44:15.090873 I | op-k8sutil: operator setting "CSI_PROVISIONER_REPLICAS" = "2"
2026-04-28 22:44:15.090880 I | op-k8sutil: operator setting "ROOK_OBC_WATCH_OPERATOR_NAMESPACE" = "true"
2026-04-28 22:44:15.090901 I | op-k8sutil: operator setting "CSI_DISABLE_HOLDER_PODS" = "true"
2026-04-28 22:44:15.090907 I | op-k8sutil: operator setting "CSI_ENABLE_CSIADDONS" = "false"
2026-04-28 22:44:15.090913 I | op-k8sutil: operator setting "CSI_ENABLE_HOST_NETWORK" = "true"
2026-04-28 22:44:15.090920 I | op-k8sutil: operator setting "ROOK_CSI_ENABLE_NFS" = "false"
2026-04-28 22:44:15.090927 I | op-k8sutil: operator setting "ROOK_ENABLE_DISCOVERY_DAEMON" = "false"
2026-04-28 22:44:15.090935 I | operator: watching all namespaces for Ceph CRs
2026-04-28 22:44:15.091045 I | operator: setting up schemes
2026-04-28 22:44:15.095120 I | operator: setting up the controller-runtime manager
2026-04-28 22:44:15.095749 I | ceph-cluster-controller: successfully started
2026-04-28 22:44:15.096289 I | ceph-cluster-controller: enabling hotplug orchestration
2026-04-28 22:44:15.096326 I | ceph-nodedaemon-controller: successfully started
2026-04-28 22:44:15.096344 I | ceph-block-pool-controller: successfully started
2026-04-28 22:44:15.096370 I | ceph-object-store-user-controller: successfully started
2026-04-28 22:44:15.096390 I | ceph-object-realm-controller: successfully started
2026-04-28 22:44:15.096405 I | ceph-object-zonegroup-controller: successfully started
2026-04-28 22:44:15.096416 I | ceph-object-zone-controller: successfully started
2026-04-28 22:44:15.096534 I | ceph-object-controller: successfully started
2026-04-28 22:44:15.096609 I | ceph-file-controller: successfully started
2026-04-28 22:44:15.096642 I | ceph-nfs-controller: successfully started
2026-04-28 22:44:15.096677 I | ceph-rbd-mirror-controller: successfully started
2026-04-28 22:44:15.096702 I | ceph-client-controller: successfully started
2026-04-28 22:44:15.096727 I | ceph-filesystem-mirror-controller: successfully started
2026-04-28 22:44:15.096759 I | operator: rook-ceph-operator-config-controller successfully started
2026-04-28 22:44:15.096777 I | ceph-csi: rook-ceph-operator-csi-controller successfully started
2026-04-28 22:44:15.096982 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started
2026-04-28 22:44:15.097008 I | ceph-bucket-topic: successfully started
2026-04-28 22:44:15.097020 I | ceph-bucket-notification: successfully started
2026-04-28 22:44:15.097077 I | ceph-bucket-notification: successfully started
2026-04-28 22:44:15.097095 I | ceph-fs-subvolumegroup-controller: successfully started
2026-04-28 22:44:15.097161 I | blockpool-rados-namespace-controller: successfully started
2026-04-28 22:44:15.097232 I | ceph-cosi-controller: successfully started
2026-04-28 22:44:15.097257 I | operator: starting the controller-runtime manager
2026-04-28 22:44:15.553381 I | operator: rook-ceph-operator-config-controller done reconciling
2026-04-28 22:44:15.775928 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config"
2026-04-28 22:44:15.780327 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-04-28 22:44:15.931091 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-04-28 22:44:15.944091 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-04-28 22:44:15.944117 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-04-28 22:44:15.947267 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-04-28 22:44:15.953228 I | ceph-csi: successfully removed CSI CephFS driver
2026-04-28 22:44:15.953248 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-04-28 22:44:15.955669 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-04-28 22:44:15.961814 I | ceph-csi: successfully removed CSI NFS driver
2026-04-28 22:44:39.913094 I | ceph-spec: adding finalizer "cephcluster.ceph.rook.io" on "ceph"
2026-04-28 22:44:39.917241 I | ceph-spec: adding finalizer "cephobjectstore.ceph.rook.io" on "ceph"
2026-04-28 22:44:39.918742 I | clusterdisruption-controller: deleted all legacy node drain canary pods
2026-04-28 22:44:39.931810 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openstack"
2026-04-28 22:44:39.940682 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-28 22:44:39.940710 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-28 22:44:39.940770 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openstack.ceph.rook.io/bucket"
2026-04-28 22:44:39.941156 I | op-bucket-prov: successfully reconciled bucket provisioner
I0428 22:44:39.941234       1 manager.go:135] "msg"="starting provisioner" "logger"="objectbucket.io/provisioner-manager" "name"="openstack.ceph.rook.io/bucket"
2026-04-28 22:44:39.941694 E | ceph-spec: failed to update cluster condition to {Type:Connecting Status:True Reason:ClusterConnecting Message:Attempting to connect to an external Ceph cluster LastHeartbeatTime:2026-04-28 22:44:39.931952434 +0000 UTC m=+24.980581598 LastTransitionTime:2026-04-28 22:44:39.931952324 +0000 UTC m=+24.980581478}. failed to update object "openstack/ceph" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ceph": the object has been modified; please apply your changes to the latest version and try again
2026-04-28 22:44:39.952812 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-28 22:44:39.952834 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-28 22:44:39.952852 I | ceph-spec: found the cluster info to connect to the external cluster. will use "client.admin" to check health and monitor status. mons=map[instance:0xc001a86ea0]
2026-04-28 22:44:39.952867 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7...
2026-04-28 22:44:40.919920 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-28 22:44:40.919948 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-28 22:44:41.561599 I | op-k8sutil: removing daemonset csi-rbdplugin if it exists
2026-04-28 22:44:41.564575 I | op-k8sutil: removing deployment csi-rbdplugin-provisioner if it exists
2026-04-28 22:44:41.577935 I | ceph-csi: successfully removed CSI Ceph RBD driver
2026-04-28 22:44:41.577950 I | op-k8sutil: removing daemonset csi-cephfsplugin if it exists
2026-04-28 22:44:41.579387 I | op-k8sutil: removing deployment csi-cephfsplugin-provisioner if it exists
2026-04-28 22:44:41.723548 I | ceph-csi: successfully removed CSI CephFS driver
2026-04-28 22:44:41.723576 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists
2026-04-28 22:44:41.725941 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists
2026-04-28 22:44:41.923302 I | ceph-csi: successfully removed CSI NFS driver
2026-04-28 22:45:00.032542 I | ceph-spec: detected ceph image version: "18.2.7-0 reef"
2026-04-28 22:45:00.032563 I | ceph-cluster-controller: validating ceph version from provided image
2026-04-28 22:45:00.037471 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-28 22:45:00.037492 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-28 22:45:00.039383 I | cephclient: writing config file /var/lib/rook/openstack/openstack.config
2026-04-28 22:45:00.039476 I | cephclient: generated admin config in /var/lib/rook/openstack
2026-04-28 22:45:01.422229 E | cephver: external cluster ceph version is a major version higher "18.2.7-0 reef" than the local cluster "0.0.0-0 <unknown version>", consider upgrading
2026-04-28 22:45:01.423646 I | clusterdisruption-controller: all PGs are active+clean. Restoring default OSD pdb settings
2026-04-28 22:45:01.423762 I | clusterdisruption-controller: creating the default pdb "rook-ceph-osd" with maxUnavailable=1 for all osd
2026-04-28 22:45:01.796405 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:45:01.979378 I | ceph-cluster-controller: cluster "openstack": version "18.2.7-0 reef" detected for image "harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7"
2026-04-28 22:45:02.103523 I | ceph-cluster-controller: creating "rook-config-override" configmap
2026-04-28 22:45:02.106477 I | ceph-cluster-controller: creating "rook-ceph-config" secret
2026-04-28 22:45:02.173914 I | ceph-cluster-controller: external cluster identity established
2026-04-28 22:45:02.178835 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner"
2026-04-28 22:45:04.669279 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:45:05.042067 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node"
2026-04-28 22:45:05.264089 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:45:06.161580 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner"
2026-04-28 22:45:06.953971 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node"
2026-04-28 22:45:11.434286 I | ceph-csi: created kubernetes csi secrets for cluster "openstack"
2026-04-28 22:45:11.503249 I | ceph-cluster-controller: successfully updated csi config map
2026-04-28 22:45:11.503287 I | cephclient: getting or creating ceph auth key "client.crash"
2026-04-28 22:45:12.050700 I | ceph-nodedaemon-controller: created kubernetes crash collector secret for cluster "openstack"
2026-04-28 22:45:12.053035 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openstack"
2026-04-28 22:45:12.053076 I | ceph-cluster-controller: ceph status check interval is 1m0s
2026-04-28 22:45:12.053083 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openstack"
2026-04-28 22:45:21.730431 I | ceph-spec: parsing mon endpoints: instance=10.96.240.200:6789
2026-04-28 22:45:21.730454 I | ceph-spec: updating obsolete maxMonID 0 to actual value 76846025234
2026-04-28 22:45:21.730467 I | ceph-spec: detecting the ceph image version for image harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.7...
2026-04-28 22:45:24.668290 I | ceph-spec: detected ceph image version: "18.2.7-0 reef"
2026-04-28 22:45:25.881583 I | ceph-object-controller: reconciling object store deployments
2026-04-28 22:45:25.893586 I | ceph-object-controller: ceph object store gateway service running at 10.110.219.138
2026-04-28 22:45:25.893625 I | ceph-object-controller: reconciling object store pools
2026-04-28 22:45:28.637909 I | cephclient: reconciling replicated pool ceph.rgw.control succeeded
2026-04-28 22:45:28.637956 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.control"
2026-04-28 22:45:32.789083 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:9} {StateName:unknown Count:8}]"
2026-04-28 22:45:32.793846 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:45:33.753859 I | cephclient: reconciling replicated pool ceph.rgw.meta succeeded
2026-04-28 22:45:33.753888 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.meta"
2026-04-28 22:45:35.581477 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:9} {StateName:unknown Count:8}]"
2026-04-28 22:45:35.585305 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:45:37.790581 I | cephclient: reconciling replicated pool ceph.rgw.log succeeded
2026-04-28 22:45:37.790609 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.log"
2026-04-28 22:45:41.880160 I | cephclient: reconciling replicated pool ceph.rgw.buckets.index succeeded
2026-04-28 22:45:41.880195 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.index"
2026-04-28 22:45:45.968546 I | cephclient: reconciling replicated pool ceph.rgw.buckets.non-ec succeeded
2026-04-28 22:45:45.968574 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.buckets.non-ec"
2026-04-28 22:45:50.032557 I | cephclient: reconciling replicated pool ceph.rgw.otp succeeded
2026-04-28 22:45:50.032592 I | cephclient: setting pool property "pg_num_min" to "8" on pool "ceph.rgw.otp"
2026-04-28 22:45:54.176246 I | cephclient: reconciling replicated pool .rgw.root succeeded
2026-04-28 22:45:54.176293 I | cephclient: setting pool property "pg_num_min" to "8" on pool ".rgw.root"
2026-04-28 22:45:58.892272 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:45:59.279715 I | cephclient: reconciling replicated pool ceph.rgw.buckets.data succeeded
2026-04-28 22:45:59.279756 I | ceph-object-controller: configuring object store "ceph"
2026-04-28 22:45:59.939099 I | ceph-object-controller: Object store "ceph": realm=ceph, zonegroup=ceph, zone=ceph
2026-04-28 22:46:00.115887 I | ceph-object-controller: committing changes to RGW configuration period for CephObjectStore "openstack/ceph"
2026-04-28 22:46:00.603339 I | ceph-object-controller: configuration for object-store ceph is complete
2026-04-28 22:46:00.606863 I | ceph-object-controller: creating object store "ceph" in namespace "openstack"
2026-04-28 22:46:00.610584 I | cephclient: getting or creating ceph auth key "client.rgw.ceph.a"
2026-04-28 22:46:01.116134 I | ceph-object-controller: setting rgw config flags
2026-04-28 22:46:01.116179 I | ceph-object-controller: Configuring authentication with keystone
2026-04-28 22:46:01.116205 I | op-config: setting option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:01.512035 I | op-config: successfully set option "rgw_keystone_admin_project" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:01.512076 I | op-config: setting option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:01.969372 I | op-config: successfully set option "rgw_keystone_admin_user" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:01.969396 I | op-config: setting option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:02.379071 I | op-config: successfully set option "rgw_log_object_name_utc" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:02.379121 I | op-config: setting option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:02.766726 I | op-config: successfully set option "rgw_keystone_accepted_roles" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:02.766756 I | op-config: setting option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:03.564108 I | op-config: successfully set option "rgw_zonegroup" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:03.564148 I | op-config: setting option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:03.848449 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:46:04.152678 I | op-config: successfully set option "rgw_keystone_implicit_tenants" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:04.152734 I | op-config: setting option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:04.578368 I | op-config: successfully set option "rgw_keystone_admin_domain" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:04.578402 I | op-config: setting option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:04.985649 I | op-config: successfully set option "rgw_keystone_admin_password" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:04.985682 I | op-config: setting option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:05.367931 I | op-config: successfully set option "rgw_log_nonexistent_bucket" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:05.367960 I | op-config: setting option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:05.886827 I | op-config: successfully set option "rgw_zone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:05.886863 I | op-config: setting option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:06.562921 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:46:06.703107 I | op-config: successfully set option "rgw_keystone_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:06.703146 I | op-config: setting option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:07.102708 I | op-config: successfully set option "rgw_keystone_api_version" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:07.102741 I | op-config: setting option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:07.492906 I | op-config: successfully set option "rgw_s3_auth_use_keystone" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:07.492940 I | op-config: setting option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:07.868534 I | op-config: successfully set option "rgw_swift_account_in_url" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:07.868577 I | op-config: setting option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:08.268682 I | op-config: successfully set option "rgw_swift_versioning_enabled" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:08.268710 I | op-config: setting option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:08.659359 I | op-config: successfully set option "rgw_run_sync_thread" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:08.659394 I | op-config: setting option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:09.055831 I | op-config: successfully set option "rgw_enable_usage_log" (user "client.rgw.ceph.a") to the mon configuration database
2026-04-28 22:46:09.056193 I | ceph-object-controller: object store "ceph" deployment "rook-ceph-rgw-ceph-a" created
2026-04-28 22:46:09.105862 I | ceph-object-controller: enabling rgw dashboard
2026-04-28 22:46:14.413698 I | ceph-object-controller: created object store "ceph" in namespace "openstack"
2026-04-28 22:46:14.414346 I | ceph-object-controller: setting the dashboard api secret key
2026-04-28 22:46:15.771127 I | ceph-object-controller: done setting the dashboard api secret key
2026-04-28 22:46:15.900419 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:46:34.311415 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:46:37.039977 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:46:44.843257 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:47:04.829238 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:47:07.670750 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:109} {StateName:activating Count:2}]"
2026-04-28 22:47:07.709698 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:47:30.765194 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:47:35.295963 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:47:38.155547 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:48:05.754930 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:99} {StateName:peering Count:2}]"
2026-04-28 22:48:05.767621 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:48:08.607646 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:48:16.760581 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:48:36.227744 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:48:39.082701 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:49:02.717159 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:49:06.704998 I | clusterdisruption-controller: all "host" failure domains: []. osd is down in failure domain: "". active node drains: false. pg health: "cluster is not fully clean. PGs: [{StateName:active+clean Count:119} {StateName:peering Count:4}]"
2026-04-28 22:49:06.708982 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:49:09.532750 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:49:37.194327 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:49:39.992394 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:49:48.677602 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:50:07.668859 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:50:10.452349 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:50:34.678540 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:50:38.142008 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:50:40.914236 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:51:08.644776 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:51:11.375087 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:51:21.663782 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:51:39.144541 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:51:41.860270 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:52:11.438164 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:52:16.540845 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:52:18.249923 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:52:41.908059 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:52:48.710443 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:53:02.451923 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:53:12.370207 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:53:19.187129 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:53:42.848448 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:53:48.364398 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:53:49.649129 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:54:13.369587 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:54:20.105901 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:54:34.332367 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:54:43.851307 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:54:50.613900 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:55:14.308175 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:55:20.264527 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:55:21.109137 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:55:44.776112 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:55:51.585602 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:56:06.185968 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:56:15.325024 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:56:22.100903 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:56:45.791978 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:56:52.114316 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:56:52.594360 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:57:16.269294 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:57:23.067806 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:57:38.084351 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:57:46.725983 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:57:53.547820 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:58:17.200902 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:58:25.742158 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:58:26.336779 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:58:48.830002 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:58:56.220189 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:59:12.319498 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 22:59:19.338110 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:59:26.692329 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:59:49.798004 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:59:57.379165 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 22:59:58.417614 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:00:20.298558 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:00:27.868532 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:00:44.360894 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:00:50.775069 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:00:58.366107 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:01:24.944802 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:01:30.993962 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:01:36.854076 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:01:59.009974 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:02:01.981981 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:02:24.342018 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:02:32.292350 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:02:34.328204 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:03:03.917327 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:03:05.802264 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:03:11.621360 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:03:34.826330 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:03:37.341084 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:03:58.108694 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:04:05.297283 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:04:07.831014 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:04:35.854448 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:04:38.299258 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:04:44.120824 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:05:06.354003 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:05:08.813243 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:05:30.091053 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:05:36.897337 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:05:39.287150 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:06:07.378062 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:06:09.793296 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:06:16.628018 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:06:37.910825 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:06:40.281118 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:07:02.625889 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:07:08.387364 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:07:10.769367 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:07:38.863298 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:07:41.247210 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:07:48.575094 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:08:09.350127 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:08:11.730470 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:08:34.538994 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:08:39.808257 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:08:42.205245 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:09:10.353816 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:09:12.703988 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:09:20.502692 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:09:40.834086 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:09:43.194524 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:10:06.495826 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:10:11.322832 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:10:13.709409 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:10:43.857518 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:10:44.534241 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:10:53.209667 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:11:14.408469 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:11:15.021591 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:11:39.206410 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:11:44.877239 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:11:45.500757 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:12:15.365220 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:12:15.967495 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:12:25.167186 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:12:45.824697 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:12:46.519326 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:13:11.194226 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:13:16.295393 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:13:17.006270 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:13:46.783755 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:13:47.653516 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:13:57.148561 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:14:17.284499 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:14:18.144610 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:14:43.316563 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:14:48.287819 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:14:48.913700 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:15:18.773301 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:15:19.400002 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:15:29.339728 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:15:49.312124 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:15:49.917868 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:16:15.361986 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:16:19.794817 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:16:20.389271 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:16:50.302453 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:16:50.859506 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:17:01.450259 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:17:20.814893 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:17:21.344050 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:18:02.854258 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:18:05.716884 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:18:06.260202 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:18:36.221799 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:18:36.721371 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:18:48.848093 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:19:07.330360 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:19:08.577927 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:19:34.815406 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:19:37.845917 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:19:39.150291 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:20:08.323244 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:20:09.739294 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:20:21.364571 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:20:38.815186 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:20:40.233420 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:21:07.358882 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:21:09.313752 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:21:10.731710 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:21:39.794602 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:21:41.209444 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:21:53.347366 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:22:10.292464 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:22:11.691294 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:22:39.360127 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:22:40.786379 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:22:42.177932 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:23:11.287530 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:23:13.674490 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:23:25.374389 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:23:41.783527 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:23:44.143987 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:24:11.348719 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:24:12.287576 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:24:14.611546 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:24:42.808382 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:24:45.099996 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:24:57.327021 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:25:13.303152 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:25:15.608558 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:25:43.359670 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:25:43.870337 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:25:46.100325 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:26:14.351202 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:26:16.605332 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:26:29.464377 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:26:44.824335 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:26:47.102141 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:27:21.155473 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:27:23.674608 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:27:29.333504 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:27:58.324553 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:28:08.729094 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:28:23.843584 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:28:44.220956 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:44.746835 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:45.227965 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:45.738787 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:46.947757 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:47.896781 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:48.779550 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:49.954459 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:52.687267 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:53.937987 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:54.465944 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:28:54.988965 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:08.844631 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: Get "https://10.96.0.1:443/apis/apps/v1/namespaces/openstack/deployments?labelSelector=app%3Drook-ceph-mon%2Cceph.rook.io%2Fdo-not-reconcile": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:13.665423 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:13.688788 E | ceph-cluster-controller: failed to retrieve ceph cluster "ceph" in namespace "openstack" to update status to &{Health:{Status:HEALTH_WARN Checks:map[POOL_NO_REDUNDANCY:{Severity:HEALTH_WARN Summary:{Message:3 pool(s) have no replicas configured}}]} FSID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 ElectionEpoch:5 Quorum:[0] QuorumNames:[instance] MonMap:{Epoch:1 NumMons:1 FSID: CreatedTime: ModifiedTime: Mons:[]} OsdMap:{Epoch:201 NumOsd:3 NumUpOsd:3 NumInOsd:3 Full:false NearFull:false NumRemappedPgs:0} PgMap:{PgsByState:[{StateName:active+clean Count:185}] Version:0 NumPgs:185 DataBytes:2273801091 UsedBytes:2515644416 AvailableBytes:3296006656000 TotalBytes:3298522300416 ReadBps:511 WriteBps:699097 ReadOps:0 WriteOps:0 RecoveryBps:0 RecoveryObjectsPerSec:0 RecoveryKeysPerSec:0 CacheFlushBps:0 CacheEvictBps:0 CachePromoteBps:0} MgrMap:{Epoch:0 ActiveGID:0 ActiveName: ActiveAddr: Available:true Standbys:[]} Fsmap:{Epoch:1 ID:0 Up:0 In:0 Max:0 ByRank:[] UpStandby:0}}
2026-04-28 23:29:13.689385 E | ceph-cluster-controller: failed to delete pod on not ready nodes. failed to get NotReady nodes: failed to list kubernetes nodes. Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:19.296757 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:27.045384 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:27.596881 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:28.129824 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:28.640886 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:29.170409 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:29.753210 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:30.243899 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:30.726128 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:31.577623 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:32.743966 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:34.557886 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:51.683350 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:52.216177 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:29:53.845614 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: Get "https://10.96.0.1:443/apis/apps/v1/namespaces/openstack/deployments?labelSelector=app%3Drook-ceph-mon%2Cceph.rook.io%2Fdo-not-reconcile": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:30:03.076747 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:30:16.744590 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:30:16.744798 E | ceph-cluster-controller: failed to retrieve ceph cluster "ceph" in namespace "openstack" to update status to &{Health:{Status:HEALTH_WARN Checks:map[POOL_NO_REDUNDANCY:{Severity:HEALTH_WARN Summary:{Message:3 pool(s) have no replicas configured}}]} FSID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 ElectionEpoch:5 Quorum:[0] QuorumNames:[instance] MonMap:{Epoch:1 NumMons:1 FSID: CreatedTime: ModifiedTime: Mons:[]} OsdMap:{Epoch:201 NumOsd:3 NumUpOsd:3 NumInOsd:3 Full:false NearFull:false NumRemappedPgs:0} PgMap:{PgsByState:[{StateName:active+clean Count:185}] Version:0 NumPgs:185 DataBytes:2324132739 UsedBytes:2565976064 AvailableBytes:3295956324352 TotalBytes:3298522300416 ReadBps:85 WriteBps:170 ReadOps:0 WriteOps:0 RecoveryBps:0 RecoveryObjectsPerSec:0 RecoveryKeysPerSec:0 CacheFlushBps:0 CacheEvictBps:0 CachePromoteBps:0} MgrMap:{Epoch:0 ActiveGID:0 ActiveName: ActiveAddr: Available:true Standbys:[]} Fsmap:{Epoch:1 ID:0 Up:0 In:0 Max:0 ByRank:[] UpStandby:0}}
2026-04-28 23:30:16.745101 E | ceph-cluster-controller: failed to delete pod on not ready nodes. failed to get NotReady nodes: failed to list kubernetes nodes. Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:30:35.168166 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:30:38.847069 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: Get "https://10.96.0.1:443/apis/apps/v1/namespaces/openstack/deployments?labelSelector=app%3Drook-ceph-mon%2Cceph.rook.io%2Fdo-not-reconcile": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:30:38.918798 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:31:17.223716 E | ceph-cluster-controller: failed to retrieve ceph cluster "ceph" in namespace "openstack" to update status to &{Health:{Status:HEALTH_WARN Checks:map[POOL_NO_REDUNDANCY:{Severity:HEALTH_WARN Summary:{Message:3 pool(s) have no replicas configured}}]} FSID:4837cbf8-4f90-4300-b3f6-726c9b9f89b4 ElectionEpoch:5 Quorum:[0] QuorumNames:[instance] MonMap:{Epoch:1 NumMons:1 FSID: CreatedTime: ModifiedTime: Mons:[]} OsdMap:{Epoch:201 NumOsd:3 NumUpOsd:3 NumInOsd:3 Full:false NearFull:false NumRemappedPgs:0} PgMap:{PgsByState:[{StateName:active+clean Count:185}] Version:0 NumPgs:185 DataBytes:2374464387 UsedBytes:2624696320 AvailableBytes:3295897604096 TotalBytes:3298522300416 ReadBps:852 WriteBps:1397870 ReadOps:0 WriteOps:0 RecoveryBps:0 RecoveryObjectsPerSec:0 RecoveryKeysPerSec:0 CacheFlushBps:0 CacheEvictBps:0 CachePromoteBps:0} MgrMap:{Epoch:0 ActiveGID:0 ActiveName: ActiveAddr: Available:true Standbys:[]} Fsmap:{Epoch:1 ID:0 Up:0 In:0 Max:0 ByRank:[] UpStandby:0}}
2026-04-28 23:31:17.224087 E | ceph-cluster-controller: failed to delete pod on not ready nodes. failed to get NotReady nodes: failed to list kubernetes nodes. Get "https://10.96.0.1:443/api/v1/nodes": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:31:23.289356 E | clusterdisruption-controller: failed to update configMap "rook-ceph-pdbstatemap" in cluster "openstack/ceph": Put "https://10.96.0.1:443/api/v1/namespaces/openstack/configmaps/rook-ceph-pdbstatemap": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:31:23.847813 W | op-mon: failed to check mon health. failed to check for mons to skip reconcile: failed to query "mon" to skip reconcile: Get "https://10.96.0.1:443/apis/apps/v1/namespaces/openstack/deployments?labelSelector=app%3Drook-ceph-mon%2Cceph.rook.io%2Fdo-not-reconcile": dial tcp 10.96.0.1:443: connect: connection refused
2026-04-28 23:31:57.653612 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:32:09.807909 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:32:28.686522 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:32:45.677703 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:32:53.235525 I | operator: rook-ceph-operator-config-controller done reconciling
2026-04-28 23:32:55.763380 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:32:59.171482 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:33:03.571536 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:33:08.819259 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:33:16.168939 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:33:29.974535 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:33:41.719938 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:33:46.659660 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:34:01.125250 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:34:17.180540 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:34:27.710576 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:34:32.459798 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:34:47.662981 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:35:02.934543 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:35:13.728059 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:35:18.164409 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:35:33.509110 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:35:48.691410 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:35:59.736001 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:36:04.009373 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:36:19.252755 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:36:36.307330 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:36:45.769785 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:36:49.752046 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:37:06.809084 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:37:20.259291 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:37:31.913938 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:37:37.308448 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:37:50.810520 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:38:07.825586 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:38:17.959704 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:38:21.361344 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:38:38.328035 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:38:51.881577 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:39:03.998915 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:39:08.824046 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:39:22.358680 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:39:39.343259 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:39:49.949306 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:39:52.849089 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:40:09.853217 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:40:23.376049 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:40:36.950442 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:40:40.369845 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:40:53.898715 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:41:10.880655 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:41:22.941479 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:41:24.512319 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:41:41.383472 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:41:55.014351 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:42:08.963199 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:42:11.955281 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:42:25.574885 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:42:42.505568 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:42:54.978435 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:42:56.108528 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:43:13.003587 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:43:26.622614 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:43:41.341522 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:43:43.518958 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:43:57.131647 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:44:14.011315 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:44:27.552255 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:44:27.865898 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:44:44.508176 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:44:58.422052 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:45:13.714962 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:45:14.996700 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:45:28.931631 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:45:45.526787 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:46:00.055817 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:46:00.393899 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:46:16.048369 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:46:30.570200 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:46:46.757960 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:46:46.954204 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:47:01.102860 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:47:17.475083 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:47:31.598693 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0
2026-04-28 23:47:32.802681 W | op-mon: external cluster mon count is 1, consider adding new monitors.
2026-04-28 23:47:47.988914 I | clusterdisruption-controller: reconciling osd pdb reconciler as the allowed disruptions in default pdb is 0