Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X...................X...................................] duration: 2.514939782s FAIL (2025-08-09 04:39:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.515068825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.....................................X.X.......X..........] duration: 1.355949655s FAIL (2025-08-09 04:39:00 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.355978091s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [..........X.X......X.......................X.X..............] duration: 324.492683ms FAIL (2025-08-09 04:38:55 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 324.519495ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X................X...........X..............X............] duration: 2.96157051s FAIL (2025-08-09 04:38:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.961622328s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X...................X..................................] duration: 2.210284308s FAIL (2025-08-09 04:38:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.210325448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 356.684319ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:38:19 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 356.709674ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [...........X.X......X.......................X.X.............] duration: 311.58866ms FAIL (2025-08-09 04:38:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 311.61403ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X...................X.................................] duration: 2.315401358s FAIL (2025-08-09 04:37:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.315427344s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X................X...........X..............X...........] duration: 2.478735287s FAIL (2025-08-09 04:37:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.478768155s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.....................................X.X.......X.........] duration: 1.239803749s FAIL (2025-08-09 04:37:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.239827557s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 322.479467ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:37:27 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 322.503331ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X................X...........X..............X..........] duration: 2.482326176s FAIL (2025-08-09 04:37:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.482364056s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 301.273122ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:37:12 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 301.30002ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [............X.X......X.......................X.X............] duration: 369.733214ms FAIL (2025-08-09 04:37:06 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 369.767766ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................X................................] duration: 2.593879614s FAIL (2025-08-09 04:36:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.593975409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.....................................X.X.......X........] duration: 1.069729251s FAIL (2025-08-09 04:36:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.069750692s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X................X...........X..............X.........] duration: 2.66974937s FAIL (2025-08-09 04:36:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.669793205s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 354.079121ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:36:31 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 354.103771ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 328.461505ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:36:08 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 328.490143ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X...................X...............................] duration: 2.347009262s FAIL (2025-08-09 04:35:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.347047882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X.....................................X.X.......X.......] duration: 1.050960037s FAIL (2025-08-09 04:35:54 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.05100337s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [.............X.X......X.......................X.X...........] duration: 320.70928ms FAIL (2025-08-09 04:35:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 320.737277ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X................X...........X..............X........] duration: 2.753272119s FAIL (2025-08-09 04:35:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.753388659s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [..............X.X......X.......................X.X..........] duration: 363.713643ms FAIL (2025-08-09 04:35:17 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 363.759435ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X................X...........X..............X.......] duration: 2.937958109s FAIL (2025-08-09 04:35:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.937986669s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X...................X..............................] duration: 2.743737322s FAIL (2025-08-09 04:35:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.74377471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 309.418742ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:34:59 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 309.446701ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X.....................................X.X.......X......] duration: 1.049005935s FAIL (2025-08-09 04:34:45 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.049027343s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 321.644357ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:34:43 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 321.67056ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X...................X.............................] duration: 2.344223596s FAIL (2025-08-09 04:34:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.344272825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 306.788195ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:34:23 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 306.822034ms edge gateway vhost us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [...............X.X......X.......................X.X.........] duration: 386.051818ms FAIL (2025-08-09 04:34:13 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 386.084281ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X................X...........X..............X......] duration: 2.832755914s FAIL (2025-08-09 04:34:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.832784229s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [................X.X......X.......................X.X........] duration: 355.585763ms FAIL (2025-08-09 04:33:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 355.680431ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X.....................................X.X.......X.....] duration: 1.059910113s FAIL (2025-08-09 04:33:48 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.059933895s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [X...............................X...........................] duration: 473.66646ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:33:47 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 473.681805ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X...................X............................] duration: 2.237910228s FAIL (2025-08-09 04:33:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.237990529s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [.................X.X......X.......................X.X.......] duration: 332.538074ms FAIL (2025-08-09 04:33:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 332.564301ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [.X...............................X..........................] duration: 300.478109ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:33:14 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 300.505803ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X.....................................X.X.......X....] duration: 1.008001158s FAIL (2025-08-09 04:33:07 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.008028445s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [..................X.X......X.......................X.X......] duration: 333.145895ms FAIL (2025-08-09 04:32:58 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 333.171797ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X................X...........X..............X.....] duration: 2.880383369s FAIL (2025-08-09 04:32:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.880415187s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [...................X.X......X.......................X.X.....] duration: 322.879504ms FAIL (2025-08-09 04:32:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 322.905671ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [X.X...............................X.........................] duration: 300.924065ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 04:32:33 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 300.94491ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X...................X...........................] duration: 2.351941903s FAIL (2025-08-09 04:32:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860 ======LOGS====== Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments... Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment... Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment. Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece... Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments... Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil> Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces. Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments... Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil> Duration: 2.351975764s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X................X...........X..............X....] duration: 2.717742523s FAIL (2025-08-09 04:32:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.717834764s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 5 out of 60 is failed (threshold=3) [....................X.X......X.......................X.X....] duration: 334.470271ms FAIL (2025-08-09 04:32:01 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 334.508361ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X.....................................X.X.......X...] duration: 1.07154771s FAIL (2025-08-09 04:31:59 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.071574319s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X................X...........X..............X...] duration: 2.687090055s FAIL (2025-08-09 04:31:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.687159206s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X............X................X...........X..............X..] duration: 2.587407612s FAIL (2025-08-09 04:31:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.58742728s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)