debug 2026-03-27T02:13:40.144+0000 7fd13441ea80 0 deferred set uid:gid to 167:167 (ceph:ceph) debug 2026-03-27T02:13:40.144+0000 7fd13441ea80 0 ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process radosgw, pid 13 debug 2026-03-27T02:13:40.144+0000 7fd13441ea80 0 framework: beast debug 2026-03-27T02:13:40.144+0000 7fd13441ea80 0 framework conf key: port, val: 8080 debug 2026-03-27T02:13:40.144+0000 7fd13441ea80 1 init_numa not setting numa affinity debug 2026-03-27T02:13:40.560+0000 7fd13441ea80 0 framework: beast debug 2026-03-27T02:13:40.560+0000 7fd13441ea80 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt debug 2026-03-27T02:13:40.560+0000 7fd13441ea80 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key debug 2026-03-27T02:13:40.572+0000 7fd13441ea80 0 starting handler: beast debug 2026-03-27T02:13:40.576+0000 7fd13441ea80 0 set uid:gid to 167:167 (ceph:ceph) debug 2026-03-27T02:13:40.600+0000 7fd13441ea80 1 mgrc service_daemon_register rgw.14512 metadata {arch=x86_64,ceph_release=reef,ceph_version=ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable),ceph_version_short=18.2.1,container_hostname=rook-ceph-rgw-ceph-a-67fd8975c6-ffj2b,container_image=harbor.atmosphere.dev/quay.io/ceph/ceph:v18.2.1,cpu=AMD EPYC-Rome Processor,distro=centos,distro_description=CentOS Stream 8,distro_version=8,frontend_config#0=beast port=8080,frontend_type#0=beast,hostname=instance,id=ceph.a,kernel_description=#183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026,kernel_version=5.15.0-173-generic,mem_swap_kb=0,mem_total_kb=65841444,num_handles=1,os=Linux,pid=13,pod_name=rook-ceph-rgw-ceph-a-67fd8975c6-ffj2b,pod_namespace=openstack,realm_id=51d73774-e1b6-4c92-831d-b9c6628a146b,realm_name=ceph,zone_id=6d86ee78-9040-43a5-aa66-f5f1d814f87c,zone_name=ceph,zonegroup_id=24b05a5f-2eb1-494f-9fbd-65b7d1a748f3,zonegroup_name=ceph} debug 2026-03-27T02:13:58.812+0000 7fd1022aa700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:13:58.820+0000 7fd0ff2a4700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=0.008000177s ====== debug 2026-03-27T02:13:58.820+0000 7fd0ff2a4700 1 beast: 0x7fcfff8a4730: 10.0.0.94 - - [27/Mar/2026:02:13:58.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.008000177s debug 2026-03-27T02:14:08.812+0000 7fd0f9298700 1 ====== starting new request req=0x7fcfff823730 ===== debug 2026-03-27T02:14:08.812+0000 7fd0f9298700 1 ====== req done req=0x7fcfff823730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:14:08.812+0000 7fd0f9298700 1 beast: 0x7fcfff823730: 10.0.0.94 - - [27/Mar/2026:02:14:08.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:14:10.556+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:14:18.812+0000 7fd0f6292700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:14:18.812+0000 7fd0f6292700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:14:18.812+0000 7fd0f6292700 1 beast: 0x7fcfff8a4730: 10.0.0.94 - - [27/Mar/2026:02:14:18.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:14:28.813+0000 7fd0f0286700 1 ====== starting new request req=0x7fcfff823730 ===== debug 2026-03-27T02:14:28.813+0000 7fd0f0286700 1 ====== req done req=0x7fcfff823730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:14:28.813+0000 7fd0f0286700 1 beast: 0x7fcfff823730: 10.0.0.94 - - [27/Mar/2026:02:14:28.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:14:38.813+0000 7fd0ea27a700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:14:38.813+0000 7fd0ea27a700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:14:38.813+0000 7fd0ea27a700 1 beast: 0x7fcfff8a4730: 10.0.0.94 - - [27/Mar/2026:02:14:38.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:14:40.561+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:14:48.813+0000 7fd0e1268700 1 ====== starting new request req=0x7fcfff823730 ===== debug 2026-03-27T02:14:48.813+0000 7fd0e1268700 1 ====== req done req=0x7fcfff823730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:14:48.813+0000 7fd0e1268700 1 beast: 0x7fcfff823730: 10.0.0.94 - - [27/Mar/2026:02:14:48.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:14:58.814+0000 7fd0e1268700 1 ====== starting new request req=0x7fcfff823730 ===== debug 2026-03-27T02:14:58.814+0000 7fd0e1268700 1 ====== req done req=0x7fcfff823730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:14:58.814+0000 7fd0e1268700 1 beast: 0x7fcfff823730: 10.0.0.94 - - [27/Mar/2026:02:14:58.814 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:15:08.810+0000 7fd0ce242700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:15:08.810+0000 7fd0ce242700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:15:08.810+0000 7fd0ce242700 1 beast: 0x7fcfff8a4730: 10.0.0.94 - - [27/Mar/2026:02:15:08.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:15:10.558+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:15:12.922+0000 7fd0cc23e700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:15:12.922+0000 7fd0cc23e700 0 req 12033698519878007285 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:15:14.302+0000 7fd0c5230700 1 ====== req done req=0x7fcfff8a4730 op status=-2042 http_status=404 latency=1.380032659s ====== debug 2026-03-27T02:15:14.302+0000 7fd0c5230700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:15:12.922 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 404 119 - "Go-http-client/1.1" - latency=1.380032659s debug 2026-03-27T02:15:14.302+0000 7fd0c7a35700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:15:14.302+0000 7fd0c7a35700 0 req 16816970228240751327 0.000000000s :create_user No stored secret string, cache miss debug 2026-03-27T02:15:14.346+0000 7fd0be222700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=0.044001039s ====== debug 2026-03-27T02:15:14.346+0000 7fd0be222700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:15:14.302 +0000] "PUT /admin/user?display-name=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42&format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=0.044001039s debug 2026-03-27T02:15:14.390+0000 7fd0c222a700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:15:14.390+0000 7fd0c222a700 0 req 3560414946129872805 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:15:14.418+0000 7fd0b6a13700 1 req 3560414946129872805 0.028000662s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 debug 2026-03-27T02:15:14.418+0000 7fd0b6a13700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=404 latency=0.028000662s ====== debug 2026-03-27T02:15:14.422+0000 7fd0b6a13700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:15:14.390 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 404 281 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000662s debug 2026-03-27T02:15:14.422+0000 7fd0bb21c700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:15:14.422+0000 7fd0bb21c700 0 req 17972154419319422231 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:15:14.482+0000 7fd0af204700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.060001414s ====== debug 2026-03-27T02:15:14.482+0000 7fd0af204700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:15:14.422 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.060001414s debug 2026-03-27T02:15:14.482+0000 7fd0b220a700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:15:14.482+0000 7fd0b220a700 0 req 4844569495289342285 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:15:14.518+0000 7fd0a71f4700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.036000848s ====== debug 2026-03-27T02:15:14.518+0000 7fd0a71f4700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:15:14.482 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000848s debug 2026-03-27T02:15:14.518+0000 7fd0ac9ff700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:15:14.518+0000 7fd0ac9ff700 0 req 1950059553530681850 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:15:14.538+0000 7fd0a21ea700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.020000473s ====== debug 2026-03-27T02:15:14.538+0000 7fd0a21ea700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:15:14.518 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000473s debug 2026-03-27T02:15:14.582+0000 7fd0a51f0700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:15:14.582+0000 7fd0a51f0700 0 req 12713016159239343438 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:15:14.618+0000 7fd09a9db700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=204 latency=0.036000848s ====== debug 2026-03-27T02:15:14.618+0000 7fd09a9db700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:15:14.582 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000848s debug 2026-03-27T02:15:18.810+0000 7fd0991d8700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:15:18.810+0000 7fd0991d8700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:15:18.810+0000 7fd0991d8700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:15:18.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:15:28.810+0000 7fd08e9c3700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:15:28.810+0000 7fd08e9c3700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:15:28.810+0000 7fd08e9c3700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:15:28.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:15:38.811+0000 7fd0861b2700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:15:38.811+0000 7fd0861b2700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:15:38.811+0000 7fd0861b2700 1 beast: 0x7fcffefa1730: 10.0.0.94 - - [27/Mar/2026:02:15:38.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:15:40.559+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:15:40.559+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=-), skipping debug 2026-03-27T02:15:48.811+0000 7fd0829ab700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:15:48.811+0000 7fd0829ab700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:15:48.811+0000 7fd0829ab700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:15:48.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:15:58.811+0000 7fd07c19e700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:15:58.811+0000 7fd07c19e700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:15:58.811+0000 7fd07c19e700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:15:58.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:16:08.811+0000 7fd07298b700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:16:08.811+0000 7fd06c17e700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:16:08.811+0000 7fd06c17e700 1 beast: 0x7fcffefa1730: 10.0.0.94 - - [27/Mar/2026:02:16:08.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:16:10.563+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:16:14.631+0000 7fd076192700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:16:14.631+0000 7fd076192700 0 req 17252614886751092300 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:16:15.655+0000 7fd076192700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.024024844s ====== debug 2026-03-27T02:16:15.655+0000 7fd076192700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:16:14.631 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.024024844s debug 2026-03-27T02:16:15.659+0000 7fd065170700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:16:15.659+0000 7fd065170700 0 req 13321112817957765755 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:16:15.683+0000 7fd06296b700 1 ====== req done req=0x7fcffefa1730 op status=-2 http_status=204 latency=0.024000579s ====== debug 2026-03-27T02:16:15.683+0000 7fd06296b700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:16:15.659 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000579s debug 2026-03-27T02:16:15.683+0000 7fd06496f700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:16:15.683+0000 7fd06496f700 0 req 10697741915395601859 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:16:15.715+0000 7fd05e963700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.032000776s ====== debug 2026-03-27T02:16:15.715+0000 7fd05e963700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:16:15.683 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000776s debug 2026-03-27T02:16:15.715+0000 7fd061969700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:16:15.715+0000 7fd061969700 0 req 2934771602379026060 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:16:15.747+0000 7fd05a15a700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.032000776s ====== debug 2026-03-27T02:16:15.747+0000 7fd05a15a700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:16:15.715 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000776s debug 2026-03-27T02:16:15.751+0000 7fd05d160700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:16:15.751+0000 7fd05d160700 0 req 18358828997926863654 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:16:15.771+0000 7fd055150700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.020000484s ====== debug 2026-03-27T02:16:15.771+0000 7fd055150700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:16:15.751 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000484s debug 2026-03-27T02:16:15.819+0000 7fd058957700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:16:15.819+0000 7fd058957700 0 req 14136087779620905148 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:16:15.855+0000 7fd04f945700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=204 latency=0.036000870s ====== debug 2026-03-27T02:16:15.855+0000 7fd04f945700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:16:15.819 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000870s debug 2026-03-27T02:16:18.836+0000 7fd04e142700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:16:18.836+0000 7fd04e142700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:16:18.836+0000 7fd04e142700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:16:18.836 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:16:28.812+0000 7fd045931700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:16:28.812+0000 7fd045931700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:16:28.812+0000 7fd045931700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:16:28.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:16:38.812+0000 7fd03d921700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:16:38.812+0000 7fd03d921700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:16:38.812+0000 7fd03d921700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:16:38.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:16:40.564+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:16:48.812+0000 7fd045130700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:16:48.812+0000 7fd045130700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:16:48.812+0000 7fd045130700 1 beast: 0x7fcfff022730: 10.0.0.94 - - [27/Mar/2026:02:16:48.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:16:58.812+0000 7fd035911700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:16:58.812+0000 7fd035911700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:16:58.812+0000 7fd035911700 1 beast: 0x7fcfff022730: 10.0.0.94 - - [27/Mar/2026:02:16:58.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:17:08.813+0000 7fd0258f1700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:17:08.813+0000 7fd0258f1700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:17:08.813+0000 7fd0258f1700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:17:08.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:17:10.573+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:17:15.869+0000 7fd0298f9700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:17:15.869+0000 7fd0298f9700 0 req 14677058455442959664 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:17:17.013+0000 7fd0298f9700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.144027829s ====== debug 2026-03-27T02:17:17.013+0000 7fd0298f9700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:17:15.869 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.144027829s debug 2026-03-27T02:17:17.017+0000 7fd0220ea700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:17:17.017+0000 7fd0220ea700 0 req 2511326743617902647 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:17:17.057+0000 7fd0190d8700 1 ====== req done req=0x7fcfff022730 op status=-2 http_status=204 latency=0.040000971s ====== debug 2026-03-27T02:17:17.057+0000 7fd0190d8700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:17:17.017 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000971s debug 2026-03-27T02:17:17.057+0000 7fd01a0da700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:17:17.057+0000 7fd01a0da700 0 req 12678004194474183259 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:17:17.089+0000 7fd0150d0700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.032000776s ====== debug 2026-03-27T02:17:17.089+0000 7fd0150d0700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:17:17.057 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000776s debug 2026-03-27T02:17:17.093+0000 7fd0178d5700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:17:17.093+0000 7fd0178d5700 0 req 9583352304354745767 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:17:17.129+0000 7fd0108c7700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.036000878s ====== debug 2026-03-27T02:17:17.129+0000 7fd0108c7700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:17:17.093 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000878s debug 2026-03-27T02:17:17.129+0000 7fd0138cd700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:17:17.129+0000 7fd0138cd700 0 req 9260397581797455350 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:17:17.153+0000 7fd00d0c0700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.024000583s ====== debug 2026-03-27T02:17:17.153+0000 7fd00d0c0700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:17:17.129 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000583s debug 2026-03-27T02:17:17.197+0000 7fd0088b7700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:17:17.197+0000 7fd0088b7700 0 req 14107811677662030831 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:17:17.233+0000 7fd1032ac700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=204 latency=0.036000878s ====== debug 2026-03-27T02:17:17.233+0000 7fd1032ac700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:17:17.197 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000878s debug 2026-03-27T02:17:18.813+0000 7fd1042ae700 1 ====== starting new request req=0x7fcffee9f730 ===== debug 2026-03-27T02:17:18.813+0000 7fd1042ae700 1 ====== req done req=0x7fcffee9f730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:17:18.813+0000 7fd1042ae700 1 beast: 0x7fcffee9f730: 10.0.0.94 - - [27/Mar/2026:02:17:18.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:17:28.813+0000 7fd0f3a8d700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:17:28.813+0000 7fd0f3a8d700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:17:28.813+0000 7fd0f3a8d700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:17:28.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:17:38.813+0000 7fd0ef284700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:17:38.813+0000 7fd0ef284700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:17:38.813+0000 7fd0ef284700 1 beast: 0x7fcffefa1730: 10.0.0.94 - - [27/Mar/2026:02:17:38.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:17:40.573+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:17:48.814+0000 7fd0f5a91700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:17:48.814+0000 7fd0f5a91700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:17:48.814+0000 7fd0f5a91700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:17:48.814 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:17:58.810+0000 7fd0df264700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:17:58.810+0000 7fd0df264700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:17:58.810+0000 7fd0df264700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:17:58.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:18:08.810+0000 7fd0d9258700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:18:08.810+0000 7fd0d9258700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:18:08.810+0000 7fd0d9258700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:18:08.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:18:10.578+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:18:17.246+0000 7fd0d324c700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:18:17.246+0000 7fd0d324c700 0 req 6149321606064965044 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:18:18.290+0000 7fd0d324c700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.044025183s ====== debug 2026-03-27T02:18:18.290+0000 7fd0d324c700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:18:17.246 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.044025183s debug 2026-03-27T02:18:18.298+0000 7fd0d1a49700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:18:18.298+0000 7fd0d1a49700 0 req 6691870417692533765 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:18:18.338+0000 7fd0ca23a700 1 ====== req done req=0x7fcffefa1730 op status=-2 http_status=204 latency=0.040000964s ====== debug 2026-03-27T02:18:18.338+0000 7fd0ca23a700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:18:18.298 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000964s debug 2026-03-27T02:18:18.342+0000 7fd0cd240700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:18:18.342+0000 7fd0cd240700 0 req 3037928405860541678 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:18:18.382+0000 7fd0cc23e700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.040000964s ====== debug 2026-03-27T02:18:18.382+0000 7fd0cc23e700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:18:18.342 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000964s debug 2026-03-27T02:18:18.382+0000 7fd0c6a33700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:18:18.382+0000 7fd0c6a33700 0 req 14527260882047547183 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:18:18.430+0000 7fd0c1a29700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.048001155s ====== debug 2026-03-27T02:18:18.430+0000 7fd0c1a29700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:18:18.382 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.048001155s debug 2026-03-27T02:18:18.430+0000 7fd0c3a2d700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:18:18.430+0000 7fd0c3a2d700 0 req 7005504575963145802 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:18:18.458+0000 7fd0bda21700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.028000675s ====== debug 2026-03-27T02:18:18.458+0000 7fd0bda21700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:18:18.430 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000675s debug 2026-03-27T02:18:18.502+0000 7fd0bfa25700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:18:18.502+0000 7fd0bfa25700 0 req 1629668499834347269 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:18:18.546+0000 7fd0b6212700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=204 latency=0.044001061s ====== debug 2026-03-27T02:18:18.546+0000 7fd0b6212700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:18:18.502 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001061s debug 2026-03-27T02:18:18.810+0000 7fd0b6a13700 1 ====== starting new request req=0x7fcffee9f730 ===== debug 2026-03-27T02:18:18.810+0000 7fd0b6a13700 1 ====== req done req=0x7fcffee9f730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:18:18.810+0000 7fd0b6a13700 1 beast: 0x7fcffee9f730: 10.0.0.94 - - [27/Mar/2026:02:18:18.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:18:28.811+0000 7fd0a79f5700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:18:28.811+0000 7fd0a79f5700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:18:28.811+0000 7fd0a79f5700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:18:28.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:18:38.811+0000 7fd09e1e2700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:18:38.811+0000 7fd09e1e2700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:18:38.811+0000 7fd09e1e2700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:18:38.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:18:40.579+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:18:48.811+0000 7fd0959d1700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:18:48.811+0000 7fd0959d1700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:18:48.811+0000 7fd0959d1700 1 beast: 0x7fcfff022730: 10.0.0.94 - - [27/Mar/2026:02:18:48.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:18:58.811+0000 7fd0919c9700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:18:58.811+0000 7fd08d1c0700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:18:58.811+0000 7fd08d1c0700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:18:58.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:19:08.812+0000 7fd0891b8700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:19:08.812+0000 7fd08e9c3700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:19:08.812+0000 7fd08e9c3700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:19:08.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:19:10.592+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:19:18.560+0000 7fd0891b8700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:19:18.560+0000 7fd0891b8700 0 req 4080379809762122864 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:19:18.812+0000 7fd07e9a3700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:19:18.812+0000 7fd07e9a3700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:19:18.812+0000 7fd07e9a3700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:19:18.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:19:19.588+0000 7fd078196700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.028023124s ====== debug 2026-03-27T02:19:19.588+0000 7fd078196700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:19:18.560 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028023124s debug 2026-03-27T02:19:19.588+0000 7fd075991700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:19:19.588+0000 7fd075991700 0 req 1643454179275847 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:19:19.612+0000 7fd07418e700 1 ====== req done req=0x7fcfff022730 op status=-2 http_status=204 latency=0.024000540s ====== debug 2026-03-27T02:19:19.612+0000 7fd07418e700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:19:19.588 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000540s debug 2026-03-27T02:19:19.612+0000 7fd076993700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:19:19.616+0000 7fd076993700 0 req 16626464606190777216 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:19:19.648+0000 7fd06f985700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.032000721s ====== debug 2026-03-27T02:19:19.648+0000 7fd06f985700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:19:19.612 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000721s debug 2026-03-27T02:19:19.648+0000 7fd06e182700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:19:19.648+0000 7fd06e182700 0 req 9275689765019174152 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:19:19.684+0000 7fd07298b700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.036000807s ====== debug 2026-03-27T02:19:19.684+0000 7fd07298b700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:19:19.648 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000807s debug 2026-03-27T02:19:19.684+0000 7fd06a17a700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:19:19.684+0000 7fd06a17a700 0 req 16027071569238843209 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:19:19.712+0000 7fd068176700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.028000629s ====== debug 2026-03-27T02:19:19.712+0000 7fd068176700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:19:19.684 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.028000629s debug 2026-03-27T02:19:19.760+0000 7fd06a97b700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:19:19.760+0000 7fd06a97b700 0 req 10273152718068004306 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:19:19.796+0000 7fd060166700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=204 latency=0.036000807s ====== debug 2026-03-27T02:19:19.796+0000 7fd060166700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:19:19.760 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000807s debug 2026-03-27T02:19:28.812+0000 7fd05c95f700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:19:28.812+0000 7fd05c95f700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:19:28.812+0000 7fd05c95f700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:19:28.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:19:38.812+0000 7fd05214a700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:19:38.812+0000 7fd05214a700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:19:38.812+0000 7fd05214a700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:19:38.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:19:40.592+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:19:48.812+0000 7fd04d140700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:19:48.812+0000 7fd04d140700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:19:48.812+0000 7fd04d140700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:19:48.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:19:58.813+0000 7fd04c93f700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:19:58.813+0000 7fd04c93f700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:19:58.813+0000 7fd04c93f700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:19:58.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:20:08.813+0000 7fd04392d700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:20:08.813+0000 7fd04392d700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:20:08.813+0000 7fd04392d700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:20:08.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:20:10.597+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:20:18.813+0000 7fd03a11a700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:20:18.813+0000 7fd03a11a700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:20:18.813+0000 7fd03a11a700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:20:18.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:20:19.813+0000 7fd03490f700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:20:19.813+0000 7fd03490f700 0 req 11606121223847406623 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:20:20.841+0000 7fd03490f700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.028023124s ====== debug 2026-03-27T02:20:20.841+0000 7fd03490f700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:20:19.813 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028023124s debug 2026-03-27T02:20:20.845+0000 7fd030106700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:20:20.845+0000 7fd030106700 0 req 7359201974402268077 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:20:20.869+0000 7fd02d901700 1 ====== req done req=0x7fcffefa1730 op status=-2 http_status=204 latency=0.024000540s ====== debug 2026-03-27T02:20:20.869+0000 7fd02d901700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:20:20.845 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000540s debug 2026-03-27T02:20:20.869+0000 7fd02f905700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:20:20.869+0000 7fd02f905700 0 req 16977914374820626659 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:20:20.901+0000 7fd02f104700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.032000721s ====== debug 2026-03-27T02:20:20.901+0000 7fd02f104700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:20:20.869 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000721s debug 2026-03-27T02:20:20.901+0000 7fd02c0fe700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:20:20.901+0000 7fd02c0fe700 0 req 3349512014733487211 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:20:20.941+0000 7fd0248ef700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.040000904s ====== debug 2026-03-27T02:20:20.941+0000 7fd0248ef700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:20:20.901 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000904s debug 2026-03-27T02:20:20.941+0000 7fd0278f5700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:20:20.941+0000 7fd0278f5700 0 req 10167398001683326120 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:20:20.965+0000 7fd0218e9700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.024000542s ====== debug 2026-03-27T02:20:20.965+0000 7fd0218e9700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:20:20.941 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000542s debug 2026-03-27T02:20:21.009+0000 7fd01d0e0700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:20:21.009+0000 7fd01d0e0700 0 req 17321279263809557476 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:20:21.045+0000 7fd01b8dd700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=204 latency=0.036000811s ====== debug 2026-03-27T02:20:21.045+0000 7fd01b8dd700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:20:21.009 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000811s debug 2026-03-27T02:20:28.813+0000 7fd0170d4700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:20:28.813+0000 7fd0170d4700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:20:28.813+0000 7fd0170d4700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:20:28.813 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:20:38.814+0000 7fd0120ca700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:20:38.814+0000 7fd0120ca700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:20:38.814+0000 7fd0120ca700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:20:38.814 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:20:40.598+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:20:48.810+0000 7fd0090b8700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:20:48.814+0000 7fd0090b8700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.004000089s ====== debug 2026-03-27T02:20:48.814+0000 7fd0090b8700 1 beast: 0x7fcfff022730: 10.0.0.94 - - [27/Mar/2026:02:20:48.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.004000089s debug 2026-03-27T02:20:58.810+0000 7fd100aa7700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:20:58.810+0000 7fd100aa7700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:20:58.810+0000 7fd100aa7700 1 beast: 0x7fcfff022730: 10.0.0.94 - - [27/Mar/2026:02:20:58.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:21:08.810+0000 7fd0fa29a700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:21:08.810+0000 7fd0fa29a700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:21:08.810+0000 7fd0fa29a700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:21:08.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:21:10.606+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:21:18.810+0000 7fd0fc29e700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:21:18.810+0000 7fd0fc29e700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:21:18.810+0000 7fd0fc29e700 1 beast: 0x7fcfff022730: 10.0.0.94 - - [27/Mar/2026:02:21:18.810 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:21:21.055+0000 7fd0f3a8d700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:21:21.055+0000 7fd0f3a8d700 0 req 17828920528586475431 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:21:22.083+0000 7fd0f3a8d700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.028022647s ====== debug 2026-03-27T02:21:22.083+0000 7fd0f3a8d700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:21:21.055 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.028022647s debug 2026-03-27T02:21:22.087+0000 7fd0e4a6f700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:21:22.087+0000 7fd0e4a6f700 0 req 1428576454323086727 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:21:22.119+0000 7fd0ea27a700 1 ====== req done req=0x7fcfff022730 op status=-2 http_status=204 latency=0.032000706s ====== debug 2026-03-27T02:21:22.119+0000 7fd0ea27a700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:21:22.087 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000706s debug 2026-03-27T02:21:22.119+0000 7fd0e9278700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:21:22.119+0000 7fd0e9278700 0 req 2472995786837406148 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:21:22.155+0000 7fd0e2a6b700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.036000792s ====== debug 2026-03-27T02:21:22.155+0000 7fd0e2a6b700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:21:22.119 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000792s debug 2026-03-27T02:21:22.155+0000 7fd0e426e700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:21:22.155+0000 7fd0e426e700 0 req 3292863989345508911 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:21:22.191+0000 7fd0dda61700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.036000792s ====== debug 2026-03-27T02:21:22.191+0000 7fd0dda61700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:21:22.155 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.036000792s debug 2026-03-27T02:21:22.191+0000 7fd0e226a700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:21:22.191+0000 7fd0e226a700 0 req 2857295305106210978 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:21:22.211+0000 7fd0df264700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=200 latency=0.020000439s ====== debug 2026-03-27T02:21:22.211+0000 7fd0df264700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:21:22.191 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.020000439s debug 2026-03-27T02:21:22.259+0000 7fd0dca5f700 1 ====== starting new request req=0x7fcfff022730 ===== debug 2026-03-27T02:21:22.259+0000 7fd0dca5f700 0 req 9802502404148834068 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:21:22.303+0000 7fd0d3a4d700 1 ====== req done req=0x7fcfff022730 op status=0 http_status=204 latency=0.044000972s ====== debug 2026-03-27T02:21:22.303+0000 7fd0d3a4d700 1 beast: 0x7fcfff022730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:21:22.259 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044000972s debug 2026-03-27T02:21:28.811+0000 7fd0d324c700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:21:28.811+0000 7fd0d324c700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:21:28.811+0000 7fd0d324c700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:21:28.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:21:38.811+0000 7fd0c4a2f700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:21:38.811+0000 7fd0c4a2f700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:21:38.811+0000 7fd0c4a2f700 1 beast: 0x7fcffefa1730: 10.0.0.94 - - [27/Mar/2026:02:21:38.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:21:40.607+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:21:48.811+0000 7fd0c7a35700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:21:48.811+0000 7fd0c7a35700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:21:48.811+0000 7fd0c7a35700 1 beast: 0x7fcffefa1730: 10.0.0.94 - - [27/Mar/2026:02:21:48.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:21:58.811+0000 7fd0bc21e700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:21:58.811+0000 7fd0bc21e700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:21:58.811+0000 7fd0bc21e700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:21:58.811 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:22:08.812+0000 7fd0bea23700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:22:08.812+0000 7fd0bea23700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:22:08.812+0000 7fd0bea23700 1 beast: 0x7fcffefa1730: 10.0.0.94 - - [27/Mar/2026:02:22:08.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:22:10.616+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping debug 2026-03-27T02:22:18.812+0000 7fd0b6a13700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:22:18.812+0000 7fd0b6a13700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:22:18.812+0000 7fd0b6a13700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:22:18.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:22:22.312+0000 7fd0ac1fe700 1 ====== starting new request req=0x7fcfff8a4730 ===== debug 2026-03-27T02:22:22.312+0000 7fd0ac1fe700 0 req 8383187968955076034 0.000000000s :get_user_info No stored secret string, cache miss debug 2026-03-27T02:22:23.352+0000 7fd0a41ee700 1 ====== req done req=0x7fcfff8a4730 op status=0 http_status=200 latency=1.040024042s ====== debug 2026-03-27T02:22:23.352+0000 7fd0a41ee700 1 beast: 0x7fcfff8a4730: 10.0.0.139 - rgw-admin-ops-user [27/Mar/2026:02:22:22.312 +0000] "GET /admin/user?format=json&uid=rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 830 - "Go-http-client/1.1" - latency=1.040024042s debug 2026-03-27T02:22:23.356+0000 7fd0a29eb700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:22:23.356+0000 7fd0a29eb700 0 req 7573529398068744522 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:22:23.380+0000 7fd09e9e3700 1 ====== req done req=0x7fcffefa1730 op status=-2 http_status=204 latency=0.024000555s ====== debug 2026-03-27T02:22:23.380+0000 7fd09e9e3700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:22:23.356 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-27T02:22:23.380+0000 7fd0a21ea700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:22:23.380+0000 7fd0a21ea700 0 req 4120805249504570147 0.000000000s s3:create_bucket No stored secret string, cache miss debug 2026-03-27T02:22:23.412+0000 7fd09a9db700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.032000739s ====== debug 2026-03-27T02:22:23.412+0000 7fd09a9db700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:22:23.380 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42 HTTP/1.1" 200 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.032000739s debug 2026-03-27T02:22:23.412+0000 7fd09c9df700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:22:23.412+0000 7fd09c9df700 0 req 3786678828007499973 0.000000000s s3:put_obj No stored secret string, cache miss debug 2026-03-27T02:22:23.456+0000 7fd0951d0700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.044001017s ====== debug 2026-03-27T02:22:23.456+0000 7fd0951d0700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:22:23.412 +0000] "PUT /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.044001017s debug 2026-03-27T02:22:23.456+0000 7fd0989d7700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:22:23.456+0000 7fd0989d7700 0 req 13137787715862908392 0.000000000s s3:get_obj No stored secret string, cache miss debug 2026-03-27T02:22:23.480+0000 7fd08e1c2700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=200 latency=0.024000555s ====== debug 2026-03-27T02:22:23.480+0000 7fd08e1c2700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:22:23.456 +0000] "GET /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 200 21 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.024000555s debug 2026-03-27T02:22:23.524+0000 7fd0949cf700 1 ====== starting new request req=0x7fcffefa1730 ===== debug 2026-03-27T02:22:23.524+0000 7fd0949cf700 0 req 9649426012029076344 0.000000000s s3:delete_obj No stored secret string, cache miss debug 2026-03-27T02:22:23.564+0000 7fd08b1bc700 1 ====== req done req=0x7fcffefa1730 op status=0 http_status=204 latency=0.040000923s ====== debug 2026-03-27T02:22:23.564+0000 7fd08b1bc700 1 beast: 0x7fcffefa1730: 10.0.0.139 - rook-ceph-internal-s3-user-checker-343db6f4-9412-40c6-98fe-c852d8461d42 [27/Mar/2026:02:22:23.524 +0000] "DELETE /rook-ceph-bucket-checker-343db6f4-9412-40c6-98fe-c852d8461d42/rookHealthCheckTestObject HTTP/1.1" 204 0 - "aws-sdk-go/1.44.118 (go1.19.4; linux; amd64)" - latency=0.040000923s debug 2026-03-27T02:22:28.812+0000 7fd0859b1700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:22:28.812+0000 7fd0859b1700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:22:28.812+0000 7fd0859b1700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:22:28.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:22:38.812+0000 7fd07b19c700 1 ====== starting new request req=0x7fcffef20730 ===== debug 2026-03-27T02:22:38.812+0000 7fd07b19c700 1 ====== req done req=0x7fcffef20730 op status=0 http_status=200 latency=0.000000000s ====== debug 2026-03-27T02:22:38.812+0000 7fd07b19c700 1 beast: 0x7fcffef20730: 10.0.0.94 - - [27/Mar/2026:02:22:38.812 +0000] "GET /swift/healthcheck HTTP/1.1" 200 0 - "kube-probe/1.28" - latency=0.000000000s debug 2026-03-27T02:22:40.616+0000 7fd132fae700 0 rgw UsageLogger: WARNING: RGWRados::log_usage(): user name empty (bucket=), skipping