debug 2026-04-16T23:08:49.961+0000 7fa75ab30a80 0 deferred set uid:gid to 167:167 (ceph:ceph) debug 2026-04-16T23:08:49.961+0000 7fa75ab30a80 0 ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process radosgw, pid 13 debug 2026-04-16T23:08:49.961+0000 7fa75ab30a80 0 framework: beast debug 2026-04-16T23:08:49.961+0000 7fa75ab30a80 0 framework conf key: port, val: 8080 debug 2026-04-16T23:08:49.961+0000 7fa75ab30a80 1 init_numa not setting numa affinity debug 2026-04-16T23:08:52.145+0000 7fa75ab30a80 0 framework: beast debug 2026-04-16T23:08:52.145+0000 7fa75ab30a80 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt debug 2026-04-16T23:08:52.145+0000 7fa75ab30a80 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key debug 2026-04-16T23:08:52.161+0000 7fa75ab30a80 0 starting handler: beast debug 2026-04-16T23:08:52.165+0000 7fa75ab30a80 0 set uid:gid to 167:167 (ceph:ceph) debug 2026-04-16T23:08:52.185+0000 7fa75ab30a80 1 mgrc service_daemon_register rgw.14508 metadata {arch=x86_64,ceph_release=reef,ceph_version=ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable),ceph_version_short=18.2.1,container_hostname=rook-ceph-rgw-ceph-a-67fd8975c6-l7vjb,container_image=harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1,cpu=AMD EPYC-Rome Processor,distro=centos,distro_description=CentOS Stream 8,distro_version=8,frontend_config#0=beast port=8080,frontend_type#0=beast,hostname=instance,id=ceph.a,kernel_description=#186-Ubuntu SMP Fri Mar 13 11:01:42 UTC 2026,kernel_version=5.15.0-176-generic,mem_swap_kb=0,mem_total_kb=65841444,num_handles=1,os=Linux,pid=13,pod_name=rook-ceph-rgw-ceph-a-67fd8975c6-l7vjb,pod_namespace=openstack,realm_id=0e93f847-9cac-4f39-ae56-cc91cfae5943,realm_name=ceph,zone_id=31390b78-20c8-492b-a994-de88771fac86,zone_name=ceph,zonegroup_id=f6c39cb2-77ea-498e-b7d7-44de37896d95,zonegroup_name=ceph} debug 2026-04-16T23:09:08.278+0000 7fa72a9c0700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:09:08.282+0000 7fa7251b5700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=0.004000096s ====== debug 2026-04-16T23:09:08.282+0000 7fa7251b5700 1 beast: 0x7fa625fb6730: 10.0.0.86 - - [16/Apr/2026:23:09:08.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000096s debug 2026-04-16T23:09:18.278+0000 7fa7229b0700 1 ====== starting new request req=0x7fa625f35730 ===== debug 2026-04-16T23:09:18.278+0000 7fa7229b0700 1 ====== req done req=0x7fa625f35730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:09:18.278+0000 7fa7229b0700 1 beast: 0x7fa625f35730: 10.0.0.86 - - [16/Apr/2026:23:09:18.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:09:22.146+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:09:28.278+0000 7fa71799a700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:09:28.278+0000 7fa71799a700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:09:28.278+0000 7fa71799a700 1 beast: 0x7fa625fb6730: 10.0.0.86 - - [16/Apr/2026:23:09:28.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:09:38.278+0000 7fa71198e700 1 ====== starting new request req=0x7fa625f35730 ===== debug 2026-04-16T23:09:38.278+0000 7fa71198e700 1 ====== req done req=0x7fa625f35730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:09:38.278+0000 7fa71198e700 1 beast: 0x7fa625f35730: 10.0.0.86 - - [16/Apr/2026:23:09:38.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:09:48.279+0000 7fa71999e700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:09:48.279+0000 7fa71999e700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:09:48.279+0000 7fa71999e700 1 beast: 0x7fa625fb6730: 10.0.0.86 - - [16/Apr/2026:23:09:48.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:09:52.147+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:09:58.275+0000 7fa70116d700 1 ====== starting new request req=0x7fa625f35730 ===== debug 2026-04-16T23:09:58.279+0000 7fa70116d700 1 ====== req done req=0x7fa625f35730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:09:58.279+0000 7fa70116d700 1 beast: 0x7fa625f35730: 10.0.0.86 - - [16/Apr/2026:23:09:58.275 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:10:08.279+0000 7fa6f815b700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:10:08.279+0000 7fa6f815b700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:10:08.279+0000 7fa6f815b700 1 beast: 0x7fa625fb6730: 10.0.0.86 - - [16/Apr/2026:23:10:08.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:10:18.279+0000 7fa6f214f700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:10:18.279+0000 7fa6f214f700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:10:18.279+0000 7fa6f214f700 1 beast: 0x7fa625fb6730: 10.0.0.86 - - [16/Apr/2026:23:10:18.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:10:22.147+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:10:22.823+0000 7fa6ea940700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:10:22.823+0000 7fa6ea940700 0 req 16011485047457518968 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:10:24.231+0000 7fa6e7139700 1 ====== req done req=0x7fa625fb6730 op status=-2042 http_status=404 latency=1.408034086s ====== debug 2026-04-16T23:10:24.231+0000 7fa6e7139700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:10:22.823 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 404 119 - "Go-http-client/1.1" - latency=1.408034086s debug 2026-04-16T23:10:24.231+0000 7fa6ea13f700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:10:24.231+0000 7fa6ea13f700 0 req 752001748570504232 0.000000000s :create_user No stored secret string, cache miss debug 2026-04-16T23:10:24.275+0000 7fa6df129700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=0.044001065s ====== debug 2026-04-16T23:10:24.275+0000 7fa6df129700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:10:24.231 +0000] "PUT /admin/user?display-name=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355&format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=0.044001065s debug 2026-04-16T23:10:24.323+0000 7fa6e2930700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:10:24.323+0000 7fa6e2930700 0 req 2975682145293819225 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:10:24.351+0000 7fa6d991e700 1 req 2975682145293819225 0.028000675s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 debug 2026-04-16T23:10:24.351+0000 7fa6d991e700 1 ====== req done req=0x7fa625734730 op status=0 http_status=404 latency=0.028000675s ====== debug 2026-04-16T23:10:24.351+0000 7fa6d991e700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:10:24.323 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 404 281 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000675s debug 2026-04-16T23:10:24.351+0000 7fa6db922700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:10:24.351+0000 7fa6db922700 0 req 5714257066884546550 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:10:24.411+0000 7fa6d210f700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.060001448s ====== debug 2026-04-16T23:10:24.411+0000 7fa6d210f700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:10:24.351 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.060001448s debug 2026-04-16T23:10:24.411+0000 7fa6d6918700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:10:24.411+0000 7fa6d6918700 0 req 1807796388837570052 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:10:25.236+0000 7fa6ca900700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.824019909s ====== debug 2026-04-16T23:10:25.236+0000 7fa6ca900700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:10:24.411 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.824019909s debug 2026-04-16T23:10:25.240+0000 7fa6d090c700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:10:25.240+0000 7fa6d090c700 0 req 6210524806334094096 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:10:25.268+0000 7fa6c68f8700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.028000675s ====== debug 2026-04-16T23:10:25.268+0000 7fa6c68f8700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:10:25.240 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000675s debug 2026-04-16T23:10:25.316+0000 7fa6c90fd700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:10:25.316+0000 7fa6c90fd700 0 req 10801514366454517582 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:10:25.356+0000 7fa6bf0e9700 1 ====== req done req=0x7fa625734730 op status=0 http_status=204 latency=0.040000964s ====== debug 2026-04-16T23:10:25.356+0000 7fa6bf0e9700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:10:25.316 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000964s debug 2026-04-16T23:10:28.280+0000 7fa6bd8e6700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:10:28.280+0000 7fa6bd8e6700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:10:28.280+0000 7fa6bd8e6700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:10:28.280 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:10:38.276+0000 7fa6b68d8700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:10:38.276+0000 7fa6b68d8700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:10:38.276+0000 7fa6b68d8700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:10:38.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:10:48.276+0000 7fa6aa0bf700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:10:48.276+0000 7fa6aa0bf700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:10:48.276+0000 7fa6aa0bf700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:10:48.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:10:52.144+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:10:52.144+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=-), skipping debug 2026-04-16T23:10:58.276+0000 7fa6a48b4700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:10:58.276+0000 7fa6a48b4700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:10:58.276+0000 7fa6a48b4700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:10:58.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:11:08.277+0000 7fa69e8a8700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:11:08.277+0000 7fa69e8a8700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:11:08.277+0000 7fa69e8a8700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:11:08.273 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:11:18.277+0000 7fa692890700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:11:18.277+0000 7fa692890700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:11:18.277+0000 7fa692890700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:11:18.273 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:11:22.157+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:11:25.369+0000 7fa69108d700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:11:25.369+0000 7fa69108d700 0 req 8853628852187551547 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:11:26.425+0000 7fa68987e700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.056024671s ====== debug 2026-04-16T23:11:26.425+0000 7fa68987e700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:11:25.369 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.056024671s debug 2026-04-16T23:11:26.429+0000 7fa68807b700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:11:26.429+0000 7fa68807b700 0 req 9681271624816132149 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:11:26.457+0000 7fa685876700 1 ====== req done req=0x7fa6256b3730 op status=-2 http_status=204 latency=0.028000653s ====== debug 2026-04-16T23:11:26.457+0000 7fa685876700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:11:26.429 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000653s debug 2026-04-16T23:11:26.457+0000 7fa68787a700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:11:26.457+0000 7fa68787a700 0 req 7371204670117374326 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:11:26.493+0000 7fa68186e700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.036000840s ====== debug 2026-04-16T23:11:26.493+0000 7fa68186e700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:11:26.457 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000840s debug 2026-04-16T23:11:26.493+0000 7fa684073700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:11:26.497+0000 7fa684073700 0 req 6604910790631189268 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:11:26.537+0000 7fa67d065700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.040000934s ====== debug 2026-04-16T23:11:26.537+0000 7fa67d065700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:11:26.493 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-04-16T23:11:26.537+0000 7fa68006b700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:11:26.537+0000 7fa68006b700 0 req 7139230661844900346 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:11:26.561+0000 7fa67905d700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.024000561s ====== debug 2026-04-16T23:11:26.561+0000 7fa67905d700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:11:26.537 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000561s debug 2026-04-16T23:11:26.609+0000 7fa67c063700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:11:26.609+0000 7fa67c063700 0 req 542611978205893263 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:11:26.649+0000 7fa672850700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=204 latency=0.040000934s ====== debug 2026-04-16T23:11:26.649+0000 7fa672850700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:11:26.609 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-04-16T23:11:28.297+0000 7fa67104d700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:11:28.297+0000 7fa67104d700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:11:28.297+0000 7fa67104d700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:11:28.297 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:11:38.277+0000 7fa66883c700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:11:38.277+0000 7fa66883c700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:11:38.277+0000 7fa66883c700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:11:38.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:11:48.278+0000 7fa66082c700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:11:48.278+0000 7fa66082c700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:11:48.278+0000 7fa66082c700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:11:48.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:11:52.158+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:11:58.278+0000 7fa65a820700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:11:58.278+0000 7fa65a820700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:11:58.278+0000 7fa65a820700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:11:58.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:12:08.278+0000 7fa65080c700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:12:08.278+0000 7fa65080c700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:12:08.278+0000 7fa65080c700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:12:08.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:12:18.278+0000 7fa6477fa700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:12:18.278+0000 7fa6477fa700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:12:18.278+0000 7fa6477fa700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:12:18.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:12:22.162+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:12:26.666+0000 7fa6427f0700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:12:26.666+0000 7fa6427f0700 0 req 15554080469088249452 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:12:27.694+0000 7fa6427f0700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.028023958s ====== debug 2026-04-16T23:12:27.694+0000 7fa6427f0700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:12:26.662 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028023958s debug 2026-04-16T23:12:27.698+0000 7fa63efe9700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:12:27.698+0000 7fa63efe9700 0 req 5509358862437668473 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:12:27.726+0000 7fa63c7e4700 1 ====== req done req=0x7fa625734730 op status=-2 http_status=204 latency=0.028000655s ====== debug 2026-04-16T23:12:27.726+0000 7fa63c7e4700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:12:27.698 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000655s debug 2026-04-16T23:12:27.726+0000 7fa63e7e8700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:12:27.726+0000 7fa63e7e8700 0 req 11689901407767885258 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:12:27.762+0000 7fa6387dc700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.036000840s ====== debug 2026-04-16T23:12:27.762+0000 7fa6387dc700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:12:27.726 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000840s debug 2026-04-16T23:12:27.762+0000 7fa63afe1700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:12:27.762+0000 7fa63afe1700 0 req 86693001995085023 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:12:27.802+0000 7fa633fd3700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.040000934s ====== debug 2026-04-16T23:12:27.802+0000 7fa633fd3700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:12:27.762 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-04-16T23:12:27.802+0000 7fa636fd9700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:12:27.802+0000 7fa636fd9700 0 req 14719115963317264182 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:12:27.826+0000 7fa6307cc700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.024000561s ====== debug 2026-04-16T23:12:27.826+0000 7fa6307cc700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:12:27.802 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000561s debug 2026-04-16T23:12:27.870+0000 7fa6327d0700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:12:27.870+0000 7fa6327d0700 0 req 1684729387094912388 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:12:27.910+0000 7fa72b1c1700 1 ====== req done req=0x7fa625734730 op status=0 http_status=204 latency=0.040000934s ====== debug 2026-04-16T23:12:27.910+0000 7fa72b1c1700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:12:27.870 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-04-16T23:12:28.278+0000 7fa7251b5700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:12:28.278+0000 7fa7251b5700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:12:28.278+0000 7fa7251b5700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:12:28.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:12:38.279+0000 7fa7219ae700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:12:38.279+0000 7fa7219ae700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:12:38.279+0000 7fa7219ae700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:12:38.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:12:48.279+0000 7fa71a9a0700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:12:48.279+0000 7fa71a9a0700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:12:48.279+0000 7fa71a9a0700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:12:48.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:12:52.163+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:12:58.279+0000 7fa70c183700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:12:58.279+0000 7fa70c183700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:12:58.279+0000 7fa70c183700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:12:58.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:13:08.279+0000 7fa70917d700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:08.279+0000 7fa70917d700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:13:08.279+0000 7fa70917d700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:13:08.275 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:13:18.280+0000 7fa70a17f700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:13:18.280+0000 7fa70a17f700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:13:18.280+0000 7fa70a17f700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:13:18.280 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:13:22.176+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:13:27.928+0000 7fa71999e700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:13:27.928+0000 7fa71999e700 0 req 4499511620023187175 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:13:28.276+0000 7fa6fa15f700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:28.276+0000 7fa6fa15f700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:13:28.276+0000 7fa6fa15f700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:13:28.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:13:28.972+0000 7fa71999e700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.044024348s ====== debug 2026-04-16T23:13:28.972+0000 7fa71999e700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:13:27.928 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044024348s debug 2026-04-16T23:13:28.992+0000 7fa6f194e700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:28.992+0000 7fa6f194e700 0 req 7160354251549565941 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:13:29.028+0000 7fa6ef149700 1 ====== req done req=0x7fa6256b3730 op status=-2 http_status=204 latency=0.036000840s ====== debug 2026-04-16T23:13:29.028+0000 7fa6ef149700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:13:28.992 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000840s debug 2026-04-16T23:13:29.028+0000 7fa6f114d700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:29.028+0000 7fa6f114d700 0 req 4360911977285587846 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:13:29.072+0000 7fa6eb141700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.044001024s ====== debug 2026-04-16T23:13:29.072+0000 7fa6eb141700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:13:29.028 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001024s debug 2026-04-16T23:13:29.072+0000 7fa6ed946700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:29.072+0000 7fa6ed946700 0 req 15144502385828081155 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:13:29.124+0000 7fa6e5135700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.052001216s ====== debug 2026-04-16T23:13:29.124+0000 7fa6e5135700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:13:29.072 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052001216s debug 2026-04-16T23:13:29.124+0000 7fa6e913d700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:29.124+0000 7fa6e913d700 0 req 9059163878566296309 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:13:29.148+0000 7fa6e212f700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.024000561s ====== debug 2026-04-16T23:13:29.148+0000 7fa6e212f700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:13:29.124 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000561s debug 2026-04-16T23:13:29.192+0000 7fa6e3131700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:13:29.192+0000 7fa6e3131700 0 req 16398821107744545681 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:13:29.232+0000 7fa6db121700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=204 latency=0.040000934s ====== debug 2026-04-16T23:13:29.232+0000 7fa6db121700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:13:29.192 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000934s debug 2026-04-16T23:13:38.276+0000 7fa6d991e700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:13:38.276+0000 7fa6d991e700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:13:38.276+0000 7fa6d991e700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:13:38.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:13:48.276+0000 7fa6cc904700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:13:48.276+0000 7fa6cc904700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:13:48.276+0000 7fa6cc904700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:13:48.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:13:52.172+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:13:58.277+0000 7fa6c70f9700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:13:58.277+0000 7fa6c70f9700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:13:58.277+0000 7fa6c70f9700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:13:58.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:14:08.277+0000 7fa6c10ed700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:14:08.277+0000 7fa6c10ed700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:14:08.277+0000 7fa6c10ed700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:14:08.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:14:18.277+0000 7fa6bc0e3700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:14:18.277+0000 7fa6bc0e3700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:14:18.277+0000 7fa6bc0e3700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:14:18.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:14:22.181+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:14:28.277+0000 7fa6b50d5700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:14:28.277+0000 7fa6b50d5700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:14:28.277+0000 7fa6b50d5700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:14:28.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:14:29.249+0000 7fa6b40d3700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:14:29.249+0000 7fa6b40d3700 0 req 13316888008103819970 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:14:30.273+0000 7fa6b40d3700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.024024248s ====== debug 2026-04-16T23:14:30.273+0000 7fa6b40d3700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:14:29.249 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.024024248s debug 2026-04-16T23:14:30.281+0000 7fa6a98be700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:14:30.281+0000 7fa6a98be700 0 req 3603186128534772325 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:14:30.301+0000 7fa6aa8c0700 1 ====== req done req=0x7fa625734730 op status=-2 http_status=204 latency=0.020000473s ====== debug 2026-04-16T23:14:30.301+0000 7fa6aa8c0700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:14:30.281 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000473s debug 2026-04-16T23:14:30.301+0000 7fa6a88bc700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:14:30.301+0000 7fa6a88bc700 0 req 4643133203307948584 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:14:30.333+0000 7fa6a38b2700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.032000758s ====== debug 2026-04-16T23:14:30.333+0000 7fa6a38b2700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:14:30.301 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000758s debug 2026-04-16T23:14:30.333+0000 7fa6a60b7700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:14:30.337+0000 7fa6a60b7700 0 req 1409810515170885254 0.004000095s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:14:30.377+0000 7fa69e0a7700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.044001039s ====== debug 2026-04-16T23:14:30.377+0000 7fa69e0a7700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:14:30.333 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001039s debug 2026-04-16T23:14:30.377+0000 7fa6a18ae700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:14:30.381+0000 7fa6a18ae700 0 req 6253211353598640433 0.004000094s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:14:30.405+0000 7fa69b8a2700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.028000660s ====== debug 2026-04-16T23:14:30.405+0000 7fa69b8a2700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:14:30.377 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000660s debug 2026-04-16T23:14:30.453+0000 7fa69d0a5700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:14:30.453+0000 7fa69d0a5700 0 req 4903407801486979246 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:14:30.497+0000 7fa693091700 1 ====== req done req=0x7fa625734730 op status=0 http_status=204 latency=0.044001039s ====== debug 2026-04-16T23:14:30.497+0000 7fa693091700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:14:30.453 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001039s debug 2026-04-16T23:14:38.277+0000 7fa69188e700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:14:38.277+0000 7fa69188e700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:14:38.277+0000 7fa69188e700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:14:38.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:14:48.278+0000 7fa68987e700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:14:48.278+0000 7fa68987e700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:14:48.278+0000 7fa68987e700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:14:48.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:14:52.182+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:14:58.278+0000 7fa68787a700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:14:58.278+0000 7fa68787a700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:14:58.278+0000 7fa68787a700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:14:58.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:15:08.274+0000 7fa68206f700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:08.278+0000 7fa68206f700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.004000094s ====== debug 2026-04-16T23:15:08.278+0000 7fa68206f700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:15:08.274 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000094s debug 2026-04-16T23:15:18.278+0000 7fa673051700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:18.278+0000 7fa673051700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:15:18.278+0000 7fa673051700 1 beast: 0x7fa6256b3730: 10.0.0.86 - - [16/Apr/2026:23:15:18.278 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:15:22.191+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:15:28.279+0000 7fa673852700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:15:28.279+0000 7fa673852700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:15:28.279+0000 7fa673852700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:15:28.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:15:30.511+0000 7fa67084c700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:15:30.511+0000 7fa67084c700 0 req 861341085596568020 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:15:31.539+0000 7fa67084c700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.028024197s ====== debug 2026-04-16T23:15:31.539+0000 7fa67084c700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:15:30.511 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028024197s debug 2026-04-16T23:15:31.543+0000 7fa664834700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:31.543+0000 7fa664834700 0 req 10872057604544432818 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:15:31.571+0000 7fa65c824700 1 ====== req done req=0x7fa6256b3730 op status=-2 http_status=204 latency=0.028000660s ====== debug 2026-04-16T23:15:31.571+0000 7fa65c824700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:15:31.543 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000660s debug 2026-04-16T23:15:31.571+0000 7fa665035700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:31.571+0000 7fa665035700 0 req 17089347589213513485 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:15:31.715+0000 7fa65801b700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.144003391s ====== debug 2026-04-16T23:15:31.715+0000 7fa65801b700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:15:31.571 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.144003391s debug 2026-04-16T23:15:31.715+0000 7fa65b822700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:31.715+0000 7fa65b822700 0 req 1293910162677935217 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:15:31.759+0000 7fa656818700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.044001039s ====== debug 2026-04-16T23:15:31.759+0000 7fa656818700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:15:31.715 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001039s debug 2026-04-16T23:15:31.759+0000 7fa655816700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:31.759+0000 7fa655816700 0 req 16670375896586241660 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:15:31.791+0000 7fa65881c700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.032000758s ====== debug 2026-04-16T23:15:31.791+0000 7fa65881c700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:15:31.759 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000758s debug 2026-04-16T23:15:31.835+0000 7fa652810700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:15:31.835+0000 7fa652810700 0 req 6750855372401105190 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:15:31.875+0000 7fa646ff9700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=204 latency=0.040000945s ====== debug 2026-04-16T23:15:31.875+0000 7fa646ff9700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:15:31.835 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000945s debug 2026-04-16T23:15:38.279+0000 7fa6477fa700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:15:38.279+0000 7fa6477fa700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:15:38.279+0000 7fa6477fa700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:15:38.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:15:48.279+0000 7fa63d7e6700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:15:48.279+0000 7fa63d7e6700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:15:48.279+0000 7fa63d7e6700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:15:48.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:15:52.191+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:15:58.279+0000 7fa6347d4700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:15:58.279+0000 7fa6347d4700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:15:58.279+0000 7fa6347d4700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:15:58.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:16:08.279+0000 7fa6307cc700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:16:08.279+0000 7fa6307cc700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:16:08.279+0000 7fa6307cc700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:16:08.279 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:16:18.283+0000 7fa7289bc700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:16:18.283+0000 7fa7289bc700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:16:18.283+0000 7fa7289bc700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:16:18.283 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:16:22.203+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:16:28.275+0000 7fa7281bb700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:16:28.275+0000 7fa7281bb700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:16:28.275+0000 7fa7281bb700 1 beast: 0x7fa625734730: 10.0.0.86 - - [16/Apr/2026:23:16:28.275 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:16:31.888+0000 7fa7231b1700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:16:31.888+0000 7fa7231b1700 0 req 3417635069205230612 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:16:32.944+0000 7fa7231b1700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.056025147s ====== debug 2026-04-16T23:16:32.944+0000 7fa7231b1700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:16:31.888 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.056025147s debug 2026-04-16T23:16:32.948+0000 7fa716197700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:16:32.948+0000 7fa716197700 0 req 8392137982038555652 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:16:32.984+0000 7fa713191700 1 ====== req done req=0x7fa625734730 op status=-2 http_status=204 latency=0.036000855s ====== debug 2026-04-16T23:16:32.984+0000 7fa713191700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:16:32.948 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000855s debug 2026-04-16T23:16:32.988+0000 7fa714193700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:16:32.988+0000 7fa714193700 0 req 12874530413502029363 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:16:33.020+0000 7fa70e187700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.032000761s ====== debug 2026-04-16T23:16:33.020+0000 7fa70e187700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:16:32.984 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000761s debug 2026-04-16T23:16:33.020+0000 7fa71218f700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:16:33.024+0000 7fa71218f700 0 req 624925320531851224 0.004000094s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:16:33.072+0000 7fa71198e700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.052001230s ====== debug 2026-04-16T23:16:33.072+0000 7fa71198e700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:16:33.020 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.052001230s debug 2026-04-16T23:16:33.072+0000 7fa70f98a700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:16:33.072+0000 7fa70f98a700 0 req 9188876573866219271 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:16:33.100+0000 7fa70817b700 1 ====== req done req=0x7fa625734730 op status=0 http_status=200 latency=0.028000664s ====== debug 2026-04-16T23:16:33.100+0000 7fa70817b700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:16:33.072 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000664s debug 2026-04-16T23:16:33.144+0000 7fa716998700 1 ====== starting new request req=0x7fa625734730 ===== debug 2026-04-16T23:16:33.144+0000 7fa716998700 0 req 16545348645692465689 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:16:33.184+0000 7fa70f189700 1 ====== req done req=0x7fa625734730 op status=0 http_status=204 latency=0.040000949s ====== debug 2026-04-16T23:16:33.184+0000 7fa70f189700 1 beast: 0x7fa625734730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:16:33.144 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000949s debug 2026-04-16T23:16:38.280+0000 7fa70a17f700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:16:38.280+0000 7fa70a17f700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:16:38.280+0000 7fa70a17f700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:16:38.280 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:16:48.276+0000 7fa6f3952700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:16:48.276+0000 7fa6f3952700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:16:48.276+0000 7fa6f3952700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:16:48.276 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:16:52.200+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:16:58.276+0000 7fa6e5936700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:16:58.276+0000 7fa6e5936700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:16:58.276+0000 7fa6e5936700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:16:58.272 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:17:08.272+0000 7fa6ea940700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:17:08.276+0000 7fa6ea940700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.004000095s ====== debug 2026-04-16T23:17:08.276+0000 7fa6ea940700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:17:08.272 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000095s debug 2026-04-16T23:17:18.277+0000 7fa6e2930700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:17:18.277+0000 7fa6e2930700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:17:18.277+0000 7fa6e2930700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:17:18.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:17:22.209+0000 7fa7596c0700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-04-16T23:17:28.277+0000 7fa6dd125700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:17:28.277+0000 7fa6dd125700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:17:28.277+0000 7fa6dd125700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:17:28.277 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-04-16T23:17:33.193+0000 7fa6d3111700 1 ====== starting new request req=0x7fa625fb6730 ===== debug 2026-04-16T23:17:33.193+0000 7fa6d3111700 0 req 9737060398765307030 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-04-16T23:17:34.221+0000 7fa6d3111700 1 ====== req done req=0x7fa625fb6730 op status=0 http_status=200 latency=1.028024435s ====== debug 2026-04-16T23:17:34.221+0000 7fa6d3111700 1 beast: 0x7fa625fb6730: 10.0.0.10 - rgw-admin-ops-user [16/Apr/2026:23:17:33.193 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028024435s debug 2026-04-16T23:17:34.225+0000 7fa6cf90a700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:17:34.225+0000 7fa6cf90a700 0 req 10349118628879630039 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:17:34.253+0000 7fa6d6918700 1 ====== req done req=0x7fa6256b3730 op status=-2 http_status=204 latency=0.028000664s ====== debug 2026-04-16T23:17:34.253+0000 7fa6d6918700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:17:34.225 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000664s debug 2026-04-16T23:17:34.253+0000 7fa6cc904700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:17:34.253+0000 7fa6cc904700 0 req 10342421526309020374 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-04-16T23:17:34.289+0000 7fa6c70f9700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.036000855s ====== debug 2026-04-16T23:17:34.289+0000 7fa6c70f9700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:17:34.253 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000855s debug 2026-04-16T23:17:34.293+0000 7fa6c48f4700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:17:34.293+0000 7fa6c48f4700 0 req 11902797739279882120 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-04-16T23:17:34.333+0000 7fa6be0e7700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.040000949s ====== debug 2026-04-16T23:17:34.333+0000 7fa6be0e7700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:17:34.293 +0000] "PUT /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000949s debug 2026-04-16T23:17:34.333+0000 7fa6c28f0700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:17:34.333+0000 7fa6c28f0700 0 req 5822408198352382767 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-04-16T23:17:34.361+0000 7fa6b98de700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=200 latency=0.028000664s ====== debug 2026-04-16T23:17:34.361+0000 7fa6b98de700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:17:34.333 +0000] "GET /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000664s debug 2026-04-16T23:17:34.409+0000 7fa6c20ef700 1 ====== starting new request req=0x7fa6256b3730 ===== debug 2026-04-16T23:17:34.409+0000 7fa6c20ef700 0 req 8398069242997582845 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-04-16T23:17:34.449+0000 7fa6b28d0700 1 ====== req done req=0x7fa6256b3730 op status=0 http_status=204 latency=0.040000953s ====== debug 2026-04-16T23:17:34.449+0000 7fa6b28d0700 1 beast: 0x7fa6256b3730: 10.0.0.10 - rook-ceph-internal-s3-user-checker-21a43a55-2adc-4c40-b476-311a9c2c4355 [16/Apr/2026:23:17:34.409 +0000] "DELETE /rook-ceph-bucket-checker-21a43a55-2adc-4c40-b476-311a9c2c4355/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000953s debug 2026-04-16T23:17:38.273+0000 7fa6b08cc700 1 ====== starting new request req=0x7fa625632730 ===== debug 2026-04-16T23:17:38.277+0000 7fa6b08cc700 1 ====== req done req=0x7fa625632730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-04-16T23:17:38.277+0000 7fa6b08cc700 1 beast: 0x7fa625632730: 10.0.0.86 - - [16/Apr/2026:23:17:38.273 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s