Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
5 out of 60 is failed (threshold=3) [.....................X.X......X.......................X.X...] duration:
323.927542ms
FAIL (2025-08-09 04:31:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 323.954014ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.....................................X.X.......X..] duration:
1.166005698s
FAIL (2025-08-09 04:31:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.166027098s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
5 out of 60 is failed (threshold=3) [......................X.X......X.......................X.X..] duration:
332.587387ms
FAIL (2025-08-09 04:31:20 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 332.609274ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
5 out of 60 is failed (threshold=3) [.......................X.X......X.......................X.X.] duration:
1m19.708216975s
FAIL (2025-08-09 04:31:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 1m19.708244632s
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [.X.X...............................X........................] duration:
341.056981ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:31:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 341.103968ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X...................X..........................] duration:
2.355590933s
FAIL (2025-08-09 04:31:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.355621262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.....................................X.X.......X.] duration:
2.066413428s
FAIL (2025-08-09 04:30:52 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.06644244s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X............X................X...........X..............X.] duration:
2.579994115s
FAIL (2025-08-09 04:30:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.580006173s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X............X................X...........X..............X] duration:
30.001652168s
FAIL (2025-08-09 04:30:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001677169s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X...................X.........................] duration:
2.57049986s
FAIL (2025-08-09 04:30:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.570537492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..........X.....................................X.X.......X] duration:
30.001451693s
FAIL (2025-08-09 04:30:05 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001476119s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [..X.X...............................X.......................] duration:
309.747866ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:30:04 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 309.786973ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
5 out of 60 is failed (threshold=3) [........................X.X......X.......................X.X] duration:
2m0.000519389s
FAIL (2025-08-09 04:30:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 2m0.000543678s
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X...................X........................] duration:
2.475161093s
FAIL (2025-08-09 04:29:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.475192015s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............X................X...........X..............] duration:
2.607851394s
FAIL (2025-08-09 04:29:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.607875248s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X..........X.....................................X.X.......] duration:
1.179589671s
FAIL (2025-08-09 04:29:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.179624804s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X...................X.......................] duration:
2.33709106s
FAIL (2025-08-09 04:29:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.337120329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [...X.X...............................X......................] duration:
354.887738ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:29:05 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 354.935963ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X..........X.....................................X.X......] duration:
3.906802822s
FAIL (2025-08-09 04:28:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 3.906828958s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............X................X...........X.............] duration:
2.654338776s
FAIL (2025-08-09 04:28:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.654371657s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..........X.....................................X.X.....] duration:
11.820112204s
FAIL (2025-08-09 04:28:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 11.820145484s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X...................X......................] duration:
3.465556593s
FAIL (2025-08-09 04:28:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 3.46559964s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X............X................X...........X............] duration:
2.818712869s
FAIL (2025-08-09 04:28:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.8187406s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [....X.X...............................X.....................] duration:
449.539346ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:27:51 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 449.567911ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X...................X.....................] duration:
2.321591392s
FAIL (2025-08-09 04:27:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.321643097s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [.....X.X...............................X....................] duration:
309.109931ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:27:30 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 309.138273ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X............X................X...........X...........] duration:
2.560298431s
FAIL (2025-08-09 04:27:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.560587571s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.X......X.......................X.] duration:
329.917629ms
FAIL (2025-08-09 04:27:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 329.940737ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..........X.....................................X.X....] duration:
1.097467796s
FAIL (2025-08-09 04:27:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.097491104s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X............X................X...........X..........] duration:
2.590480674s
FAIL (2025-08-09 04:27:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.590515692s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X............X................X...........X.........] duration:
2.921011198s
FAIL (2025-08-09 04:26:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.92103076s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...................X....................] duration:
2.425822522s
FAIL (2025-08-09 04:26:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.425852166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X............X................X...........X........] duration:
2.680582931s
FAIL (2025-08-09 04:26:40 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.680609918s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [X.....X.X...............................X...................] duration:
287.861546ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:26:23 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 287.89521ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...................X...................] duration:
2.43849588s
FAIL (2025-08-09 04:26:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.438524043s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........X.....................................X.X...] duration:
1.208123617s
FAIL (2025-08-09 04:26:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.208169903s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
5 out of 60 is failed (threshold=3) [XX.....X.X...............................X..................] duration:
323.443777ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:25:48 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 323.473416ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.........X............X................X...........X.......] duration:
2.557014936s
FAIL (2025-08-09 04:25:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.557048269s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..........X.....................................X.X..] duration:
1.331326484s
FAIL (2025-08-09 04:25:41 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.331373589s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...................X..................] duration:
2.310855939s
FAIL (2025-08-09 04:25:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.310920546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
6 out of 60 is failed (threshold=3) [XXX.....X.X...............................X.................] duration:
310.496854ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:25:10 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 310.528772ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.X......X.......................] duration:
309.306508ms
FAIL (2025-08-09 04:25:10 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 309.340499ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.........X............X................X...........X......] duration:
2.909756359s
FAIL (2025-08-09 04:25:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.909780359s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..........X.....................................X.X.] duration:
1.398888531s
FAIL (2025-08-09 04:24:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.398908258s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...................X.................] duration:
2.343159457s
FAIL (2025-08-09 04:24:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 41687ee9b93a5d813caa7756acb24d489ae2e6c4eb19aec432e01b99850a480a != before 1335b1f2cb2ce6696414af19a6d6643baadfdd41a516ddf8c68ca41730288860
======LOGS======
Aug 9 04:12:01.646979891 (10h46m23.606077145s) [upload=11150]: Starting upload
Aug 9 04:12:01.647104616 (10h46m23.606201863s) [upload=11150]: Done starting upload
Aug 9 04:12:01.647216957 (10h46m23.60631421s) [upload=11150]: Uploading segments...
Aug 9 04:12:01.647663685 (10h46m23.606760934s) [upload=11150]: Got next segment. Inline: false
Aug 9 04:12:01.647732003 (10h46m23.606829252s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 04:12:01.647739185 (10h46m23.606836432s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 04:12:01.887154737 (10h46m23.846251991s) [seg_pos={0 0}, upload=11150]: Begin upload segment...
Aug 9 04:12:01.887240529 (10h46m23.846337782s) [seg_pos={0 0}, upload=11150]: Done begin upload segment.
Aug 9 04:12:01.887314577 (10h46m23.846411831s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888013374 (10h46m23.847110628s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888595678 (10h46m23.847692933s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.888822542 (10h46m23.847919798s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.889522618 (10h46m23.848619874s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.890806684 (10h46m23.849903939s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.892565940 (10h46m23.851663195s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893052633 (10h46m23.852149888s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893078770 (10h46m23.852176007s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.893557406 (10h46m23.852654662s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894112561 (10h46m23.853209818s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894335435 (10h46m23.853432691s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894550929 (10h46m23.853648183s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.894957491 (10h46m23.854054747s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.895821047 (10h46m23.854918302s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.897266725 (10h46m23.85636398s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.899314784 (10h46m23.858412027s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:01.900862792 (10h46m23.859960049s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Uploading piece...
Aug 9 04:12:02.501493581 (10h46m24.460590831s) [upload=11150]: Next returned nil segment
Aug 9 04:12:02.501522901 (10h46m24.460620157s) [upload=11150]: Waiting for error group managing segments...
Aug 9 04:12:02.665194444 (10h46m24.624291696s) [noise=true , address=104.36.82.61:4377 , piece_id=NMWHNUIWXNUQEGZTUXDMI5CFOUVSZAJNSFKY47VA27ZVCJR4UB7Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668650307 (10h46m24.627747541s) [noise=true , address=104.36.82.17:4355 , piece_id=S6URKL6JPLGMRI4YMGBG5MJYRK2O6APCGTA2OTTAJSBQE55MSCUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.668739322 (10h46m24.627836575s) [noise=true , address=104.36.82.45:4935 , piece_id=PDGJKBMSBQZO2M6GXLHVSEXBFZAJGDHPB2JGG7PZJHP23FND7JQA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.670546998 (10h46m24.629644244s) [noise=true , address=104.36.82.23:4464 , piece_id=OGOA4QI3B7DFXXYH5PFNHHPW2CX2Q22WOAS23DTMYFO6QKRVAZNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673520328 (10h46m24.632617582s) [noise=true , address=104.36.82.5:4851 , piece_id=6SKQCLHRNVM6DYGC6HRV3KLK7CMIU7WJ6O6FFUXGZ62X7M5A3GXA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.673611974 (10h46m24.632709206s) [noise=true , address=104.36.82.19:4429 , piece_id=3TPP42ZBS5TCY242J243EQ4IKFX4TDI55FUW3ZCOH3HJ3H5ZXXZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.674417973 (10h46m24.633515226s) [noise=true , address=104.36.82.39:4746 , piece_id=TMHIXRCXHD2NV76GUJNFD642WD26JGLZS4IDABBGQNUTWZSTZ77Q, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.678265011 (10h46m24.637362251s) [noise=true , address=104.36.82.52:4103 , piece_id=VYJ4ETZOF5BLCENO6H6H46ID25Y7QGRU57T32ICGRRGG3YBE3GLA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.679816702 (10h46m24.638913949s) [noise=true , address=104.36.82.12:4179 , piece_id=YPLP74ZUET4O3YQRCSUNTH6JR76X6DTSM3OFMHCJU3S4JRWPZMUQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680222976 (10h46m24.639320216s) [noise=true , address=104.36.82.5:4853 , piece_id=6PMYJMOZE35RGGY32QWXOB6VI3JBTWVCEUAILCVTCKJVQ57IQKVA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.680914353 (10h46m24.64001159s) [noise=true , address=104.36.82.47:4534 , piece_id=HNLVK3HJBP6BLKIJFEXTLAE4VM5C6UUD6G6O32WKXB4TT52WI7VQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681000990 (10h46m24.64009823s) [noise=true , address=104.36.82.16:4310 , piece_id=BUVTBGL7YSGBHO23KQWPN5JBJE2XIGFDIZ4O6N67BQYSCCDA2IZQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.681461387 (10h46m24.640558637s) [noise=true , address=104.36.82.44:4896 , piece_id=JNKO3SFPAZF3NIZML7KGHQIMZ7JEVU6T5KS43O5DFWYXO4X2ACQQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691731060 (10h46m24.650828315s) [noise=true , address=104.36.82.60:4344 , piece_id=DPRJHDUCMG27DE4B3L6H4QFRSUZRXSFDQ5YGUQVBD5BZ5N4FFAJA, seg_pos={0 0}, upload=11150]: Done uploading piece. err: <nil>
Aug 9 04:12:02.691785740 (10h46m24.65088299s) [seg_pos={0 0}, upload=11150]: Segment reached optimal threshold of 14 pieces.
Aug 9 04:12:02.692108880 (10h46m24.651206135s) [noise=true , address=104.36.82.4:4815 , piece_id=X3WBPEQJHLWJE53MKYF4WVFHA3PMUXNI6PDZX4ALOX5LMFF7OQMQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692300699 (10h46m24.651397952s) [noise=true , address=104.36.82.42:4830 , piece_id=3Y5XK5SC5Q7DNSXFT3R4HH5LWRK2UGFNFGN6NVMGQNV7L6WBCW2A, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:142ocSHHtv8BpSebXFNk5qk1Y23a8pbFAZqE3cq6i3RMX3dPw9): protocol: expected piece hash; context canceled; EOF
Aug 9 04:12:02.692924439 (10h46m24.652021686s) [noise=true , address=64.49.13.170:4719 , piece_id=HBIROZAYZWI7H4EOFIA7WIMU2EQR25N47FJ4Z5ENXRGGJOYAFQNQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45022->64.49.13.170:4719: use of closed network connection
Aug 9 04:12:02.693005032 (10h46m24.652102273s) [noise=true , address=64.49.13.169:4708 , piece_id=UINLIHQVGRJULYSU7NYWHXSJ7A4XYXSTXBLK45D5L7LWXKLEZNJQ, seg_pos={0 0}, upload=11150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CTzrehDEVX9VJdfpPHUwmixehj18F1hsPLhifikqU9B3Gt3Hy): protocol: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40886->64.49.13.169:4708: use of closed network connection
Aug 9 04:12:02.693043476 (10h46m24.65214071s) [seg_pos={0 0}, upload=11150]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 04:12:02.693193424 (10h46m24.652290686s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 04:12:02.693201302 (10h46m24.652298559s) [upload=11150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 04:12:02.843330010 (10h46m24.802427258s) [upload=11150]: Done uploading segments...
Aug 9 04:12:02.843350265 (10h46m24.802447504s) [upload=11150]: Upload finished. err: <nil>
Duration: 2.343191302s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
3 out of 60 is failed (threshold=3) [............................X.X......X......................] duration:
317.413487ms
FAIL (2025-08-09 04:24:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 317.449902ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..........X.....................................X.X] duration:
10.099368269s
FAIL (2025-08-09 04:24:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.099397816s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
6 out of 60 is failed (threshold=3) [.XXX.....X.X...............................X................] duration:
472.49223ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:24:06 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 472.519078ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
845.101376ms
FAIL (2025-08-09 04:23:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:38:21.391404361 (10h12m43.350501607s) [upload=10580]: Starting upload Aug 9 03:38:21.391499574 (10h12m43.350596824s) [upload=10580]: Done starting upload Aug 9 03:38:21.391580214 (10h12m43.35067745s) [upload=10580]: Uploading segments... Aug 9 03:38:21.391626103 (10h12m43.350723357s) [upload=10580]: Got next segment. Inline: true Aug 9 03:38:21.391640756 (10h12m43.350738001s) [upload=10580]: Waiting for error group managing segments... Aug 9 03:38:21.391684974 (10h12m43.350782221s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 03:38:21.391714671 (10h12m43.350811918s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 03:38:21.391718801 (10h12m43.35081605s) [upload=10580]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 03:38:21.563255973 (10h12m43.522353225s) [upload=10580]: Done uploading segments... Aug 9 03:38:21.563291106 (10h12m43.522388342s) [upload=10580]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.126108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.........X............X................X...........X.....] duration:
3.043641195s
FAIL (2025-08-09 04:23:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 3.043680351s
edge
gateway
us-select-1
|