Orbiter History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.X......X.............] duration: 320.165967ms FAIL (2025-08-09 04:17:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 320.204977ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.......................X...................X.......] duration: 2.407286604s FAIL (2025-08-09 04:17:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.407323174s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.103281179s FAIL (2025-08-09 04:17:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.103306464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.........X............X................X.........] duration: 2.723212946s FAIL (2025-08-09 04:17:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723236034s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.........X..XXX.....X.X...............................X.....] duration: 525.548123ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:17:15 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 525.582192ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.......................X...................X......] duration: 2.559298s FAIL (2025-08-09 04:17:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.559329069s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.X......X............] duration: 331.422752ms FAIL (2025-08-09 04:17:03 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 331.457439ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.........X............X................X........] duration: 2.791349333s FAIL (2025-08-09 04:16:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.791370543s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.......................X...................X.....] duration: 2.560067015s FAIL (2025-08-09 04:16:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.560118237s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [..........X..XXX.....X.X...............................X....] duration: 449.772307ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:16:41 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 449.798487ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X..........X...............................] duration: 1.002140166s FAIL (2025-08-09 04:16:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.002180136s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.X......X...........] duration: 300.221556ms FAIL (2025-08-09 04:16:33 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 300.255018ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.........X............X................X.......] duration: 2.575940986s FAIL (2025-08-09 04:16:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.576019806s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.093000094s FAIL (2025-08-09 04:16:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.093114569s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.X......X..........] duration: 343.211162ms FAIL (2025-08-09 04:16:13 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 343.237233ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X..........X..............................] duration: 20.890319952s FAIL (2025-08-09 04:16:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.890346484s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.......................X...................X....] duration: 2.338791042s FAIL (2025-08-09 04:15:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.338821894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.........X............X................X......] duration: 2.762816457s FAIL (2025-08-09 04:15:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.762896087s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [...........X..XXX.....X.X...............................X...] duration: 310.301001ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:15:39 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 310.342175ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [X........................................X.X......X.........] duration: 300.547724ms FAIL (2025-08-09 04:15:23 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 300.572089ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [............X..XXX.....X.X...............................X..] duration: 328.920363ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:15:19 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 329.031669ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.036881255s FAIL (2025-08-09 04:15:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.036914816s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X..........X.............................] duration: 1.167847115s FAIL (2025-08-09 04:15:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.167879837s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.......................X...................X...] duration: 2.37096012s FAIL (2025-08-09 04:14:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.371048033s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.........X............X................X.....] duration: 2.587893675s FAIL (2025-08-09 04:14:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.58791516s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.............X..XXX.....X.X...............................X.] duration: 400.7864ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:14:41 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 400.80856ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [.X........................................X.X......X........] duration: 324.219973ms FAIL (2025-08-09 04:14:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 324.25972ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.092021909s FAIL (2025-08-09 04:14:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.092066644s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X.........X............X................X....] duration: 2.528571214s FAIL (2025-08-09 04:14:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.52860832s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X.......................X...................X..] duration: 2.458999151s FAIL (2025-08-09 04:14:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.459031311s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...................X..........X............................] duration: 1.45903843s FAIL (2025-08-09 04:13:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.459073103s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X............X..............................................] duration: 871.473272ms FAIL (2025-08-09 04:13:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 871.559028ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X...................X..........X...........................] duration: 1.073345802s FAIL (2025-08-09 04:13:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.073367882s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X.........X............X................X...] duration: 4.274111851s FAIL (2025-08-09 04:13:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.274213883s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [..X........................................X.X......X.......] duration: 325.006813ms FAIL (2025-08-09 04:13:06 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 325.043899ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X............X.............................................] duration: 962.290277ms FAIL (2025-08-09 04:13:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 962.349331ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.......................X...................X.] duration: 2.574937542s FAIL (2025-08-09 04:12:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.574965436s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [...X........................................X.X......X......] duration: 374.022101ms FAIL (2025-08-09 04:12:49 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 374.06161ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X.........X............X................X..] duration: 2.772832621s FAIL (2025-08-09 04:12:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.77285093s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X............X............................................] duration: 987.971123ms FAIL (2025-08-09 04:12:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 988.000041ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.......................X...................X] duration: 2.591381135s FAIL (2025-08-09 04:12:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.591412836s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...................X..........X..........................] duration: 1.173273488s FAIL (2025-08-09 04:12:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.17332477s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [...............X..XXX.....X.X...............................] duration: 298.412522ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:11:58 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 298.434062ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X.........X............X................X.] duration: 2.635640782s FAIL (2025-08-09 04:11:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.63566693s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 4 out of 60 is failed (threshold=3) [....X........................................X.X......X.....] duration: 334.065038ms FAIL (2025-08-09 04:11:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 334.087323ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X............X...........................................] duration: 1.080873595s FAIL (2025-08-09 04:11:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.080900836s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [................X..XXX.....X.X..............................] duration: 452.106246ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:11:35 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 452.156067ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X.......................X...................] duration: 2.293238323s FAIL (2025-08-09 04:11:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 03:55:22.143759676 (10h29m44.10285692s) [upload=10871]: Starting upload Aug 9 03:55:22.143812813 (10h29m44.102910057s) [upload=10871]: Done starting upload Aug 9 03:55:22.143932181 (10h29m44.103029427s) [upload=10871]: Uploading segments... Aug 9 03:55:22.144063992 (10h29m44.103161237s) [upload=10871]: Got next segment. Inline: false Aug 9 03:55:22.144103663 (10h29m44.103200909s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:55:22.144108033 (10h29m44.103205279s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:55:22.344140014 (10h29m44.303237259s) [seg_pos={0 0}, upload=10871]: Begin upload segment... Aug 9 03:55:22.344190230 (10h29m44.303287465s) [seg_pos={0 0}, upload=10871]: Done begin upload segment. Aug 9 03:55:22.344241693 (10h29m44.303338943s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.344712874 (10h29m44.303810123s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345037423 (10h29m44.304134668s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345359148 (10h29m44.304456399s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.345744398 (10h29m44.304841644s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346149512 (10h29m44.305246803s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346393756 (10h29m44.305491013s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346552983 (10h29m44.305650229s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346804907 (10h29m44.30590216s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.346863880 (10h29m44.305961132s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347094395 (10h29m44.306191643s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347154723 (10h29m44.306251977s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347352448 (10h29m44.306449697s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347443699 (10h29m44.306540953s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.347752140 (10h29m44.30684939s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348045599 (10h29m44.307142858s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348372798 (10h29m44.307470046s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.348673074 (10h29m44.30777033s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Uploading piece... Aug 9 03:55:22.911067156 (10h29m44.870164401s) [upload=10871]: Next returned nil segment Aug 9 03:55:22.911084172 (10h29m44.870181416s) [upload=10871]: Waiting for error group managing segments... Aug 9 03:55:23.048261951 (10h29m45.007359196s) [noise=true , address=45.91.116.14:4200 , piece_id=3NK2RKJPXS4UAJXY55I2LHQRX7D3ZPKWFG3SMSV4EZ7MHUROSGRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.064939046 (10h29m45.024036292s) [noise=true , address=104.36.82.60:4359 , piece_id=2DZPFT7KW2BGOQZXKLQM64FS4Q7QJQPQUNTDMRPVKV5JU3KQN4MQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.066143838 (10h29m45.025241084s) [noise=true , address=104.36.82.47:4533 , piece_id=SR7G6S2Z3AGRWND572QYBPMKDNRK3MD6QRUMBDYLRM2ZYVNFVUTQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.068805794 (10h29m45.027903038s) [noise=true , address=104.36.82.59:4323 , piece_id=YVKZVOU4QTUNNHC3W3UUF3KISTPJ3HMU5QIGGFOPFRLS2R3XEF3Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.074735109 (10h29m45.03383234s) [noise=true , address=104.36.82.45:4913 , piece_id=A53X5FREON2B3TPU4OJA6GY7743MG63MPW6KJEQ4ICMJEV5QZMYQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.076585738 (10h29m45.035682976s) [noise=true , address=104.36.82.15:4267 , piece_id=6QVBPNZGKNZEH35LRTWXLMZIVNYSUXFLGF4UXA7VOBUUI4LHRSLQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.078307083 (10h29m45.037404316s) [noise=true , address=104.36.82.44:4872 , piece_id=ZDQMVJGYPL4R7H2MSYDPVGLKN4B7FG3SCGVZMDU5MFLVISQ3DC6Q, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.080903255 (10h29m45.040000501s) [noise=true , address=104.36.82.58:4296 , piece_id=AGVDDRLZXAAXATA72TY76JNH7P6J6RSFRZFCI7FNT6SSEBNQ6HAA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.084965825 (10h29m45.044063057s) [noise=true , address=104.36.82.2:4759 , piece_id=B35NJJJ7E6ULFD5OGVDMH4OIC77IGELIRP7AUAJWOYJAGKPDNWRA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.086897888 (10h29m45.045995124s) [noise=true , address=104.36.82.45:4907 , piece_id=BP2W2L76MWDS6W2PQRPK2P3COOD75G75D37ZUGFCY2NOWXBSZGEQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.088234355 (10h29m45.047331591s) [noise=true , address=104.36.82.46:4482 , piece_id=MJM7TS3NQTQJ2D4SMYDGDS2FX3AUICTMXSYJO2LE4F3F74CFBOAQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.090326389 (10h29m45.049423623s) [noise=true , address=104.36.82.12:4158 , piece_id=NDGI2BLPE4IMV2JWEZ5AXPHRBT6MSME4UNNGYDOKDOIA6PYSS3TA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096118399 (10h29m45.055215633s) [noise=true , address=104.36.82.23:4458 , piece_id=5R5O366APTWEUDTZG5GWTSDBNX5S53VZPO2K2U3ZD45OEXBSPHUA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096577595 (10h29m45.05567483s) [noise=true , address=104.36.82.38:4720 , piece_id=6BMWQEPTWJXMPD5VYOCHEERBK374TUXUNUFEH4W427CGZU33Z4CA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: <nil> Aug 9 03:55:23.096630675 (10h29m45.05572792s) [seg_pos={0 0}, upload=10871]: Segment reached optimal threshold of 14 pieces. Aug 9 03:55:23.096843965 (10h29m45.055941203s) [noise=true , address=104.36.82.21:4496 , piece_id=OPJLKLLJ7SUYZ4BZ325AANRWXDQJM6JPBSC6JHT3WTI5SGVRHQNA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uPsj1cL28HYcNZYjinFAwBHx4bWeSz1E1ndTDYE3y6DwbZg7w): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097165055 (10h29m45.056262294s) [noise=true , address=104.36.82.16:4319 , piece_id=JZKTOUWZW7SWGC3737OGKA5R2V64ANU5ZIXNMLDA4GKCG77Y55HA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097248518 (10h29m45.056345754s) [noise=true , address=64.49.13.140:4511 , piece_id=T7H2CXRTLLZOTJTPVD6BYSVSPWEGB4Y3C2VCIZMZGX5F3RKRYNLA, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59802->64.49.13.140:4511: use of closed network connection Aug 9 03:55:23.097330100 (10h29m45.056427345s) [noise=true , address=104.36.82.39:4739 , piece_id=R3OAUKXTNBEEZMXX3CJDT2CASE3HLBXNPKD4EGRRFFFF7EGTQ2YQ, seg_pos={0 0}, upload=10871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A4nWQsS43tSv3atCnj6CB2ZGKFxQUHJp8a7ftP9y1XumeFk33): protocol: expected piece hash; context canceled; EOF Aug 9 03:55:23.097345526 (10h29m45.056442772s) [seg_pos={0 0}, upload=10871]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:55:23.097442993 (10h29m45.056540238s) [upload=10871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:55:23.097448165 (10h29m45.056545413s) [upload=10871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:55:23.258254104 (10h29m45.21735135s) [upload=10871]: Done uploading segments... Aug 9 03:55:23.258294964 (10h29m45.217392209s) [upload=10871]: Upload finished. err: <nil> Duration: 2.293274146s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X.........X............X................X] duration: 30.000608942s FAIL (2025-08-09 04:11:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000630498s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [.................X..XXX.....X.X.............................] duration: 465.440733ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:10:56 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 465.463705ms edge gateway vhost us-select-1

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)