Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...................X................] duration: 2.44814391s FAIL (2025-08-09 04:23:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.448235207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [..XXX.....X.X...............................X...............] duration: 315.202168ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:23:44 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 315.232697ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.X......X.....................] duration: 366.827681ms FAIL (2025-08-09 04:23:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 366.852328ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 827.944484ms FAIL (2025-08-09 04:23:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 827.974381ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.......................X...................X...............] duration: 2.413749579s FAIL (2025-08-09 04:23:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.413790352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.........X............X................X...........X....] duration: 4.587546733s FAIL (2025-08-09 04:23:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 4.587587271s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [X..XXX.....X.X...............................X..............] duration: 338.418494ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:23:05 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 338.443193ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X..........X.....................................X.] duration: 900.632802ms FAIL (2025-08-09 04:23:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 900.661498ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.X......X....................] duration: 983.813202ms FAIL (2025-08-09 04:22:35 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 983.899117ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X..........X.....................................X] duration: 30.001243614s FAIL (2025-08-09 04:22:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001332312s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 974.174565ms FAIL (2025-08-09 04:22:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 974.219427ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.......................X...................X..............] duration: 2.69920882s FAIL (2025-08-09 04:22:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.699235709s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.X..XXX.....X.X...............................X.............] duration: 289.238332ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:22:17 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 289.260799ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.........X............X................X...........X...] duration: 3.21717882s FAIL (2025-08-09 04:22:07 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 3.21720949s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 989.848965ms FAIL (2025-08-09 04:22:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 989.876116ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.......................X...................X.............] duration: 2.493628076s FAIL (2025-08-09 04:21:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.493662476s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [..X..XXX.....X.X...............................X............] duration: 307.370134ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:21:25 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 307.400507ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X..........X.....................................] duration: 1.062207048s FAIL (2025-08-09 04:21:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.062229417s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.......................X...................X............] duration: 2.243688907s FAIL (2025-08-09 04:21:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.243715148s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.X......X...................] duration: 336.562866ms FAIL (2025-08-09 04:21:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 336.674763ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.........X............X................X...........X..] duration: 2.700317872s FAIL (2025-08-09 04:21:14 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 2.700352232s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.108733973s FAIL (2025-08-09 04:21:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.108764092s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [...X..XXX.....X.X...............................X...........] duration: 349.928911ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:20:57 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 349.954418ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.......................X...................X...........] duration: 2.347727249s FAIL (2025-08-09 04:20:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.347759958s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [....X..XXX.....X.X...............................X..........] duration: 308.769844ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:20:41 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 308.787765ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X..........X....................................] duration: 1.086816779s FAIL (2025-08-09 04:20:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.086846527s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [................................X.X......X..................] duration: 344.915281ms FAIL (2025-08-09 04:20:23 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 344.941996ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.........X............X................X...........X.] duration: 3.073662397s FAIL (2025-08-09 04:20:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 3.07369356s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.......................X...................X..........] duration: 2.31577824s FAIL (2025-08-09 04:20:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.315841528s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.....X..XXX.....X.X...............................X.........] duration: 336.225355ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:20:04 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 336.255788ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 873.26026ms FAIL (2025-08-09 04:20:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 873.363025ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X..........X...................................] duration: 1.10287313s FAIL (2025-08-09 04:19:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.102897086s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.X......X.................] duration: 327.254002ms FAIL (2025-08-09 04:19:52 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 327.361473ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [......X..XXX.....X.X...............................X........] duration: 303.965155ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:19:34 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 304.071189ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.........X............X................X...........X] duration: 10.104070283s FAIL (2025-08-09 04:19:29 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 10.104112299s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.......................X...................X.........] duration: 2.349398548s FAIL (2025-08-09 04:19:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.349428057s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.X......X................] duration: 331.339359ms FAIL (2025-08-09 04:19:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 331.390787ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X..........X..................................] duration: 1.323210412s FAIL (2025-08-09 04:19:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.323254383s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.........X............X................X...........] duration: 2.726735412s FAIL (2025-08-09 04:19:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.72708116s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.......X..XXX.....X.X...............................X.......] duration: 319.020182ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:18:59 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 319.049108ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 867.045139ms FAIL (2025-08-09 04:18:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 867.136415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.X......X...............] duration: 338.107205ms FAIL (2025-08-09 04:18:52 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 338.137298ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X..........X.................................] duration: 1.180183248s FAIL (2025-08-09 04:18:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.18020563s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.......................X...................X........] duration: 2.433933261s FAIL (2025-08-09 04:18:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.433965583s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.........X............X................X..........] duration: 2.578505966s FAIL (2025-08-09 04:18:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.578540771s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.089502472s FAIL (2025-08-09 04:18:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.089528969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 884.690492ms FAIL (2025-08-09 04:18:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests Duration:* 884.767609ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.X......X..............] duration: 351.612016ms FAIL (2025-08-09 04:18:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 351.639395ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [........X..XXX.....X.X...............................X......] duration: 1.762973646s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:17:53 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 1.763009937s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X..........X................................] duration: 1.073342617s FAIL (2025-08-09 04:17:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.073376515s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)