Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X...................X..........X...............] duration: 1.308679504s FAIL (2025-08-09 04:03:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.308699268s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [...........X........................................X.X.....] duration: 342.559807ms FAIL (2025-08-09 04:03:40 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 342.590967ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [..........................X..XXX.....X.X....................] duration: 326.091413ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:03:37 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 326.116819ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X....................X.........X............X........] duration: 2.708260671s FAIL (2025-08-09 04:03:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.708282242s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X............X................................] duration: 847.680084ms FAIL (2025-08-09 04:03:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 847.709975ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.......................X.........] duration: 2.288923506s FAIL (2025-08-09 04:02:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.28896672s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [............X........................................X.X....] duration: 302.762682ms FAIL (2025-08-09 04:02:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 302.790554ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X....................X.........X............X.......] duration: 2.387716738s FAIL (2025-08-09 04:02:48 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.387736011s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X...................X..........X..............] duration: 1.137864726s FAIL (2025-08-09 04:02:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.137888043s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X............X...............................] duration: 864.74987ms FAIL (2025-08-09 04:02:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 864.775262ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [...........................X..XXX.....X.X...................] duration: 311.996902ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:02:33 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 312.041816ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X...................X..........X.............] duration: 2.158058186s FAIL (2025-08-09 04:02:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.158073724s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [.............X........................................X.X...] duration: 329.540827ms FAIL (2025-08-09 04:02:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 329.568993ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X...................X..........X............] duration: 1.304336787s FAIL (2025-08-09 04:02:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.304362171s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.......................X........] duration: 2.258403513s FAIL (2025-08-09 04:01:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.258440768s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [..............X........................................X.X..] duration: 349.275234ms FAIL (2025-08-09 04:01:43 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 349.302312ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X....................X.........X............X......] duration: 2.828063167s FAIL (2025-08-09 04:01:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.828419143s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [............................X..XXX.....X.X..................] duration: 360.601897ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:01:41 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 360.637599ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X............X..............................] duration: 937.591146ms FAIL (2025-08-09 04:01:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 937.630881ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X...................X..........X...........] duration: 1.466198685s FAIL (2025-08-09 04:01:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.466224179s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [.............................X..XXX.....X.X.................] duration: 1.443986001s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:01:13 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 1.444009702s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X.......................X.......] duration: 2.412770969s FAIL (2025-08-09 04:01:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.412817898s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X....................X.........X............X.....] duration: 2.8622744s FAIL (2025-08-09 04:01:01 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.862307805s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X...................X..........X..........] duration: 1.052186387s FAIL (2025-08-09 04:00:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.052264754s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [..............................X..XXX.....X.X................] duration: 472.607814ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:00:45 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 472.632541ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [...............X........................................X.X.] duration: 347.671856ms FAIL (2025-08-09 04:00:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 347.722786ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X............X.............................] duration: 952.229225ms FAIL (2025-08-09 04:00:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 952.262608ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.......................X......] duration: 2.688176072s FAIL (2025-08-09 04:00:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.688211577s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X....................X.........X............X....] duration: 2.785030673s FAIL (2025-08-09 04:00:09 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.785060109s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.......................X.....] duration: 2.87997197s FAIL (2025-08-09 04:00:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.880004409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X............X............................] duration: 824.550057ms FAIL (2025-08-09 03:59:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 824.582946ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [...............................X..XXX.....X.X...............] duration: 287.357391ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:59:47 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 287.379717ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X...................X..........X.........] duration: 1.081313203s FAIL (2025-08-09 03:59:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.081343488s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [................................X..XXX.....X.X..............] duration: 296.965561ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:59:30 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 296.993083ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X....................X.........X............X...] duration: 2.483510292s FAIL (2025-08-09 03:59:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.483538356s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X...................X..........X........] duration: 1.212377842s FAIL (2025-08-09 03:59:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.212425283s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.......................X....] duration: 2.274513764s FAIL (2025-08-09 03:58:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.274546338s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X............X...........................] duration: 830.519761ms FAIL (2025-08-09 03:58:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 830.549457ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X....................X.........X............X..] duration: 2.67905331s FAIL (2025-08-09 03:58:29 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.679281474s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [.................................X..XXX.....X.X.............] duration: 329.400033ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:58:19 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 329.428761ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...................X..........X.......] duration: 1.162127114s FAIL (2025-08-09 03:58:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.162156518s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X.......................X...] duration: 2.384880411s FAIL (2025-08-09 03:58:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.38491162s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.................X........................................X.] duration: 330.222727ms FAIL (2025-08-09 03:58:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 330.249045ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..................X........................................X] duration: 2m0.00033345s FAIL (2025-08-09 03:58:03 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 2m0.000479693s edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X....................X.........X............X.] duration: 2.582556032s FAIL (2025-08-09 03:57:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.582670473s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X............X..........................] duration: 984.500621ms FAIL (2025-08-09 03:57:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 984.531851ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X...................X..........X......] duration: 1.22327569s FAIL (2025-08-09 03:57:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.223324637s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [..................................X..XXX.....X.X............] duration: 310.773061ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:57:38 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 310.808644ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.......................X..] duration: 2.401192906s FAIL (2025-08-09 03:57:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.401286907s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X....................X.........X............X] duration: 10.124186152s FAIL (2025-08-09 03:57:27 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.124212205s edge gateway us-select-1

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)