Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.X....................X.......XX.....................] duration:
1.04784029s
FAIL (2025-08-14 06:14:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.047875049s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..........X...................................X..........] duration:
2.605607566s
FAIL (2025-08-14 06:14:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.605648653s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.X....................X.......XX....................] duration:
841.040599ms
FAIL (2025-08-14 06:13:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.073806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..........X...................................X.........] duration:
2.463990576s
FAIL (2025-08-14 06:13:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.464026076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.X....................X.......XX...................] duration:
825.753084ms
FAIL (2025-08-14 06:13:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 825.783853ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X..........X...................................X........] duration:
2.455367544s
FAIL (2025-08-14 06:13:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.455399533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.X....................X.......XX..................] duration:
822.737742ms
FAIL (2025-08-14 06:12:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.78903ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..........X...................................X.......] duration:
2.528290022s
FAIL (2025-08-14 06:12:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.528324099s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.X....................X.......XX.................] duration:
825.405572ms
FAIL (2025-08-14 06:11:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 825.567297ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..........X...................................X......] duration:
2.337675503s
FAIL (2025-08-14 06:11:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.337724489s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.X....................X.......XX................] duration:
810.663345ms
FAIL (2025-08-14 06:10:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 810.696041ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.X....................X.......XX...............] duration:
840.177358ms
FAIL (2025-08-14 06:10:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.225079ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........X...................................X.....] duration:
2.394947265s
FAIL (2025-08-14 06:09:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.394980344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X.X....................X.......XX..............] duration:
931.851578ms
FAIL (2025-08-14 06:09:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 931.881012ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X..........X...................................X....] duration:
2.380817441s
FAIL (2025-08-14 06:08:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.380842611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X.X....................X.......XX.............] duration:
834.605371ms
FAIL (2025-08-14 06:08:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.649284ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........X...................................X...] duration:
2.470082931s
FAIL (2025-08-14 06:08:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.470116122s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X.X....................X.......XX............] duration:
847.873165ms
FAIL (2025-08-14 06:08:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 847.909825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........X...................................X..] duration:
2.423630289s
FAIL (2025-08-14 06:07:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.423712174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........X...................................X.] duration:
2.513534755s
FAIL (2025-08-14 06:07:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 2.513562685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [................X.X....................X.......XX...........] duration:
869.055508ms
FAIL (2025-08-14 06:07:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.164533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X..........X...................................X] duration:
1.571203687s
FAIL (2025-08-14 06:06:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 06:06:37.540933026 (132h40m59.500030282s) [upload=138232]: Starting upload
Aug 14 06:06:37.541009540 (132h40m59.500106795s) [upload=138232]: Done starting upload
Aug 14 06:06:37.541115816 (132h40m59.500213065s) [upload=138232]: Uploading segments...
Aug 14 06:06:37.541427197 (132h40m59.500524447s) [upload=138232]: Got next segment. Inline: false
Aug 14 06:06:37.541502260 (132h40m59.500599509s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 06:06:37.541509474 (132h40m59.500606729s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 06:06:37.734608198 (132h40m59.693705432s) [seg_pos={0 0}, upload=138232]: Begin upload segment...
Aug 14 06:06:37.734678297 (132h40m59.693775551s) [seg_pos={0 0}, upload=138232]: Done begin upload segment.
Aug 14 06:06:37.734706334 (132h40m59.693803583s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735180380 (132h40m59.694277629s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.735227086 (132h40m59.694324334s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736188816 (132h40m59.695286072s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736234610 (132h40m59.695331862s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736343279 (132h40m59.695440527s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736861132 (132h40m59.695958384s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.736975202 (132h40m59.69607245s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737485795 (132h40m59.696583042s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.737693565 (132h40m59.696790814s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738169077 (132h40m59.697266325s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738278695 (132h40m59.697375943s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738667442 (132h40m59.697764678s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.738956844 (132h40m59.698054095s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.739787790 (132h40m59.698885037s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740093943 (132h40m59.699191191s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.740359825 (132h40m59.69945706s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:37.741729577 (132h40m59.700826813s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Uploading piece...
Aug 14 06:06:38.281838399 (132h41m0.240935651s) [upload=138232]: Next returned nil segment
Aug 14 06:06:38.281862975 (132h41m0.240960236s) [upload=138232]: Waiting for error group managing segments...
Aug 14 06:06:38.447137406 (132h41m0.406234652s) [noise=true , address=77.90.31.12:4622 , piece_id=MNBHYOGNVTMVWXNDE6CVVZH4VRQJ4SOTOA67S6X56VSFKNQIARHA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.450788735 (132h41m0.409885973s) [noise=true , address=77.90.31.17:4797 , piece_id=YBQ6CIO4VALLFN3XHGC6ZICATYSMSEH4G73GHCVLBGAYOZN7TACA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451372723 (132h41m0.410469955s) [noise=true , address=77.90.31.11:4561 , piece_id=NINCTSENWLVRR5CFYO7MAXUTZZIMZ72IHP5W5V2Z2LXQICR6F27Q, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.451823429 (132h41m0.410920666s) [noise=true , address=77.90.31.16:4759 , piece_id=7CLRBZA7GXSNESZIJSFUUMZX5R6KAXENW3NZPYDGYC6KQY42CJVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.454672130 (132h41m0.413769369s) [noise=true , address=77.90.31.18:4819 , piece_id=ZXLK6Y6OSROEQVRKL2RXPZNFEQVROMRWVZ64PP25BQ2JDNX5PUYA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455158741 (132h41m0.414255976s) [noise=true , address=77.90.31.14:4675 , piece_id=4YEIELPRGLMRVLEANPAYIKF3DWUOTWIOD4ZXCOQW4NFYKVXSXDEA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.455761299 (132h41m0.414858539s) [noise=true , address=77.90.31.19:4873 , piece_id=7WB6YMCWZT4FX3SHU24ME54T34FGO4G5MPD7IJ2RGISOB3O35OOA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.469780650 (132h41m0.428877889s) [noise=true , address=104.36.82.37:4663 , piece_id=KYF6CHSGIJSNPHKG6A4EBYHW3CUL2XMRNGQT3QPE7F2UI7VQRNAA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.484425638 (132h41m0.443522874s) [noise=true , address=104.36.82.8:4998 , piece_id=PZB7BM34B4OJ3MX7YHWGZ4P4G7PZ2TE6BRDGYQXY5ZPSM6QHLBIA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.485654993 (132h41m0.444752226s) [noise=true , address=104.36.82.60:4343 , piece_id=C6TYYXWL4VHRFVKNHWLLD2DXSUGO2VFBYQLTJKYSCI6P4SA4ANQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.492865222 (132h41m0.451962457s) [noise=true , address=104.36.82.7:4942 , piece_id=W6XZ4Y2U4PWTRH3RZJZ7V4PDVIGT2IXBYLCYINSN553JB4KHIPVA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.493317829 (132h41m0.452415061s) [noise=true , address=104.36.82.19:4411 , piece_id=YPJXVZJ3O6N3NDJ2BWDBYORYYRYRYME7FKOWBSLIQ4AKGYMGEYDQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.498309077 (132h41m0.457406314s) [noise=true , address=104.36.82.17:4347 , piece_id=OPR6ER7Z5HW3FIL4TECEIY7HCZH2KJQN566DOAFBHKISWM46WXWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501302262 (132h41m0.460399508s) [noise=true , address=104.36.82.23:4476 , piece_id=NUCIRNSHGDXG2IF5V5ZZPZUOEEPOSZ5JHAPOSLMQ5CKCKMRR7JXQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: <nil>
Aug 14 06:06:38.501326243 (132h41m0.460423492s) [seg_pos={0 0}, upload=138232]: Segment reached optimal threshold of 14 pieces.
Aug 14 06:06:38.501581157 (132h41m0.460678407s) [noise=true , address=104.36.82.44:4903 , piece_id=QJK3LTAXBJUXA5TCULFB234C6STWYEL4I7KBB5JB4LV232MYEVWQ, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501673376 (132h41m0.460770623s) [noise=true , address=104.36.82.18:4386 , piece_id=2CAPOBU6FJNBAXSILUNIYYBYDDDCE3OKB3PO47ZR4A3TRFOQGKDA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1f2xD6zuVoTHDPq2UT4bfH7fwkPhe6B4Hd1Jp7LFV6718Gr6GH): protocol: expected piece hash; context canceled; EOF
Aug 14 06:06:38.501839948 (132h41m0.460937194s) [noise=true , address=66.23.193.175:4561 , piece_id=67MKLE4SHJXASVY46SK357F623XBMT6PAQ7QM54VFWO4KZRZENQA, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38746->66.23.193.175:4561: use of closed network connection
Aug 14 06:06:38.501961345 (132h41m0.461058591s) [noise=true , address=79.127.201.215:4351 , piece_id=U3UFJF6SFY5WALF3FO32BCLOEYEWXP57QVK2T3AOA33W5QVE7W6A, seg_pos={0 0}, upload=138232]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WutpFSoqFPT4wPcAAsjsZD5WZy8boff1HmVefLHLyTfKNndy6): protocol: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47362->79.127.201.215:4351: use of closed network connection
Aug 14 06:06:38.501977415 (132h41m0.461074655s) [seg_pos={0 0}, upload=138232]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 06:06:38.502069155 (132h41m0.461166402s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 06:06:38.502074512 (132h41m0.461171758s) [upload=138232]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 06:06:38.651243030 (132h41m0.610340266s) [upload=138232]: Done uploading segments...
Aug 14 06:06:38.651266673 (132h41m0.61036391s) [upload=138232]: Upload finished. err: <nil>
Duration: 1.571237318s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........X...................................] duration:
2.298468626s
FAIL (2025-08-14 06:06:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.298499319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.................X.X....................X.......XX..........] duration:
842.505062ms
FAIL (2025-08-14 06:06:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.587938ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........X..................................] duration:
2.372766282s
FAIL (2025-08-14 06:05:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.372804023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........X.................................] duration:
2.507026335s
FAIL (2025-08-14 06:05:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.507060511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..................X.X....................X.......XX.........] duration:
859.0797ms
FAIL (2025-08-14 06:05:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.117912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..........X................................] duration:
2.448329299s
FAIL (2025-08-14 06:04:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.448368684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...................X.X....................X.......XX........] duration:
852.857897ms
FAIL (2025-08-14 06:04:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.905457ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....................X.X....................X.......XX.......] duration:
827.517956ms
FAIL (2025-08-14 06:03:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.552796ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..........X...............................] duration:
2.520424025s
FAIL (2025-08-14 06:02:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.520459665s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....................X.X....................X.......XX......] duration:
842.625237ms
FAIL (2025-08-14 06:02:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.658695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......................X.X....................X.......XX.....] duration:
839.472124ms
FAIL (2025-08-14 06:02:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.541582ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..........X..............................] duration:
2.344803679s
FAIL (2025-08-14 06:01:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.344854807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......................X.X....................X.......XX....] duration:
850.498143ms
FAIL (2025-08-14 06:01:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 850.530753ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..........X.............................] duration:
2.549913241s
FAIL (2025-08-14 06:01:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.549953168s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..........X............................] duration:
2.61248378s
FAIL (2025-08-14 06:00:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.612522906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........................X.X....................X.......XX...] duration:
842.330674ms
FAIL (2025-08-14 06:00:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.370325ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..........X...........................] duration:
2.621355002s
FAIL (2025-08-14 06:00:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.621467681s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........................X.X....................X.......XX..] duration:
963.271186ms
FAIL (2025-08-14 06:00:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 963.376123ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..........X..........................] duration:
2.347035909s
FAIL (2025-08-14 05:59:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.347077077s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........................X.X....................X.......XX.] duration:
839.608312ms
FAIL (2025-08-14 05:59:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.645476ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..........X.........................] duration:
2.459985066s
FAIL (2025-08-14 05:58:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.460019951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........................X.X....................X.......XX] duration:
357.006395ms
FAIL (2025-08-14 05:58:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 05:58:43.857080357 (132h33m5.816177612s) [upload=138092]: Starting upload Aug 14 05:58:43.857172427 (132h33m5.816269681s) [upload=138092]: Done starting upload Aug 14 05:58:43.857257043 (132h33m5.81635429s) [upload=138092]: Uploading segments... Aug 14 05:58:43.857364965 (132h33m5.81646222s) [upload=138092]: Got next segment. Inline: true Aug 14 05:58:43.857372572 (132h33m5.816469828s) [upload=138092]: Waiting for error group managing segments... Aug 14 05:58:43.857451408 (132h33m5.816548661s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:58:43.857458096 (132h33m5.816555354s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:58:43.857461692 (132h33m5.81655894s) [upload=138092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:58:43.944473715 (132h33m5.903570971s) [upload=138092]: Done uploading segments... Aug 14 05:58:43.944495959 (132h33m5.903593219s) [upload=138092]: Upload finished. err: metaclient: Too Many Requests
Duration: 357.031569ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................X.X....................X.......X] duration:
706.061028ms
FAIL (2025-08-14 05:58:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 05:58:16.419358399 (132h32m38.378455655s) [upload=138084]: Starting upload
Aug 14 05:58:16.419437409 (132h32m38.37853466s) [upload=138084]: Done starting upload
Aug 14 05:58:16.419519635 (132h32m38.378616866s) [upload=138084]: Uploading segments...
Aug 14 05:58:16.419671183 (132h32m38.378768439s) [upload=138084]: Got next segment. Inline: true
Aug 14 05:58:16.419682712 (132h32m38.378779962s) [upload=138084]: Waiting for error group managing segments...
Aug 14 05:58:16.419745723 (132h32m38.378843035s) [upload=138084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:58:16.419751717 (132h32m38.378848966s) [upload=138084]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 05:58:16.419755665 (132h32m38.378852912s) [upload=138084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:58:16.556328679 (132h32m38.515425925s) [upload=138084]: Done uploading segments...
Aug 14 05:58:16.556350035 (132h32m38.515447271s) [upload=138084]: Upload finished. err: <nil>
Duration: 706.092284ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..........X........................] duration:
2.360967597s
FAIL (2025-08-14 05:57:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.360998298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X.X....................X.......] duration:
2.06955603s
FAIL (2025-08-14 05:57:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 2.069588896s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..........X.......................] duration:
2.465015194s
FAIL (2025-08-14 05:57:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.465060222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.X....................X......] duration:
850.010172ms
FAIL (2025-08-14 05:56:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 05:52:21.588993460 (132h26m43.5480907s) [upload=137984]: Starting upload Aug 14 05:52:21.589044714 (132h26m43.548141963s) [upload=137984]: Done starting upload Aug 14 05:52:21.589100646 (132h26m43.548197882s) [upload=137984]: Uploading segments... Aug 14 05:52:21.589178515 (132h26m43.548275769s) [upload=137984]: Got next segment. Inline: true Aug 14 05:52:21.589186753 (132h26m43.548284001s) [upload=137984]: Waiting for error group managing segments... Aug 14 05:52:21.589240617 (132h26m43.548337862s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 05:52:21.589245663 (132h26m43.548342908s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 05:52:21.589248391 (132h26m43.548345636s) [upload=137984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 05:52:21.735067562 (132h26m43.694164816s) [upload=137984]: Done uploading segments... Aug 14 05:52:21.735114572 (132h26m43.694211812s) [upload=137984]: Upload finished. err: <nil>
Duration: 850.042967ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..........X......................] duration:
2.561635595s
FAIL (2025-08-14 05:56:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 05:40:05.157423001 (132h14m27.116520236s) [upload=137773]: Starting upload
Aug 14 05:40:05.157506109 (132h14m27.116603348s) [upload=137773]: Done starting upload
Aug 14 05:40:05.157699175 (132h14m27.116796426s) [upload=137773]: Uploading segments...
Aug 14 05:40:05.157823310 (132h14m27.116920562s) [upload=137773]: Got next segment. Inline: false
Aug 14 05:40:05.157896447 (132h14m27.116993699s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 05:40:05.157904876 (132h14m27.117002127s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 05:40:05.353447549 (132h14m27.3125448s) [seg_pos={0 0}, upload=137773]: Begin upload segment...
Aug 14 05:40:05.353546202 (132h14m27.312643455s) [seg_pos={0 0}, upload=137773]: Done begin upload segment.
Aug 14 05:40:05.353621911 (132h14m27.312719173s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353636791 (132h14m27.312734049s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.353732528 (132h14m27.312829787s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354237702 (132h14m27.313334961s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354302381 (132h14m27.313399642s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354733563 (132h14m27.313830821s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.354925793 (132h14m27.314023057s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355179338 (132h14m27.314276596s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355468467 (132h14m27.314565725s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.355809145 (132h14m27.314906403s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356097009 (132h14m27.315194268s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356262977 (132h14m27.31536024s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356657882 (132h14m27.315755133s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.356717563 (132h14m27.315814827s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357156507 (132h14m27.316253765s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357165911 (132h14m27.316263172s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357587468 (132h14m27.316684724s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.357601938 (132h14m27.316699173s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Uploading piece...
Aug 14 05:40:05.927547359 (132h14m27.886644606s) [upload=137773]: Next returned nil segment
Aug 14 05:40:05.927847114 (132h14m27.886944369s) [upload=137773]: Waiting for error group managing segments...
Aug 14 05:40:06.061776758 (132h14m28.020874015s) [noise=true , address=77.90.31.12:4622 , piece_id=CHDHMZ5OU3CUIJZPIEF5ZPQL3O66SBRTNRXFOTVDEBC2ZQCLEDJQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.062697203 (132h14m28.021794435s) [noise=true , address=77.90.31.17:4783 , piece_id=N3RQYFLHYY3HTQJOYBIXKQXL3LT6ATUSKJJMHLEHLEZNWDRQG52Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.063387130 (132h14m28.022484368s) [noise=true , address=77.90.31.13:4652 , piece_id=IRL6EKM7YJSKZ5RVIPSAHYLDMB73O2FV74N44QIID5ADQHAKEWUQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.073554712 (132h14m28.032651951s) [noise=true , address=77.90.31.21:4881 , piece_id=4UGAV7PIIHYT3FH2KZTOJE53CL4IFQFR7JUOXHTO4QQRKF5S4O4Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.074561087 (132h14m28.033658334s) [noise=true , address=77.90.31.11:4573 , piece_id=5RTRRGYOAGVGJMWBZRJ7YSAQEKW2VXUYZAK4YYFGBSYDGINO24AQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.084124486 (132h14m28.043221726s) [noise=true , address=104.36.82.35:4612 , piece_id=EMDUYMUE37CCMIN7JX5W4ZTGVFSUGB467RGC6RVOR2IAJ33MC5KA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.090082078 (132h14m28.049179379s) [noise=true , address=104.36.82.60:4344 , piece_id=MY7TL2CQ7WXIA54F5QZIZZF3EZ7VEJCV7AR625KQX4W7D33PNCZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103083246 (132h14m28.062180499s) [noise=true , address=104.36.82.58:4299 , piece_id=Q5EXIGYUIYAMHEWUAD365N6DMXJAS2LK4YPJ7ZXN3PK44ETRKL5A, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.103313504 (132h14m28.062410743s) [noise=true , address=104.36.82.38:4709 , piece_id=3FZNV55XT7NZOI6PLSD7FHFD34X7BNNHB3JS22G67WVLZZLZE2CA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.105472945 (132h14m28.064570202s) [noise=true , address=104.36.82.23:4474 , piece_id=3X2DH66O3FBICHBOSXAKKP5MNP3QXPGHMHKAHQR2BIYHNK7IKWHA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.114195640 (132h14m28.073292885s) [noise=true , address=77.90.31.15:4700 , piece_id=HWJXWF35YR2XYK52AOMYAMQEFPARRFWNRLSZEUUVPGCBT2CX6TGA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.120978529 (132h14m28.080075776s) [noise=true , address=104.36.82.8:4986 , piece_id=CPB3SQALOL6MFKJ2DN354HNSRQB4NRHPVKLSQWRE2BVZXPPNLSQQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.135374209 (132h14m28.094471456s) [noise=true , address=104.36.82.5:4856 , piece_id=365IP2KZSTTINRNK7NX4A4QK5LYTQJMYDE6P63OZJQGI7HZU3YBQ, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164013135 (132h14m28.123110401s) [noise=true , address=104.36.82.37:4683 , piece_id=6LELGQIFKFRFRHGQQ3GXWOH5A77QJVPQ4CLARWHAOSAVYPNK2DUA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: <nil>
Aug 14 05:40:06.164055257 (132h14m28.123152504s) [seg_pos={0 0}, upload=137773]: Segment reached optimal threshold of 14 pieces.
Aug 14 05:40:06.164327669 (132h14m28.12342491s) [noise=true , address=104.36.82.44:4893 , piece_id=5N7MEI24RTCEPZFY3ZXPSMLZHKAQJD6PQUDNOWDPTBBAX4DTFG3Q, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17VMFZ2T8jrSJVtchciJ9SnyrR6JstvcMoXrN5Q3zTD1aQU1oJ): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164373322 (132h14m28.123470576s) [noise=true , address=104.36.82.39:4745 , piece_id=LGMEFWU7CMB4NGWWL7EQBX3GPO5FPX6HFTQ6QJVSF5APHLFHIFQA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164459985 (132h14m28.123557234s) [noise=true , address=66.23.193.175:4559 , piece_id=2PNBDZJNPJDQLBYG37MSLAHUISIGLE6UG5YI4LCH3GPYS32EA6ZA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36252->66.23.193.175:4559: use of closed network connection
Aug 14 05:40:06.164496164 (132h14m28.123593404s) [noise=true , address=79.127.201.215:4350 , piece_id=NPT6MAHYZ2FMEKHGM7A7CCJYCE3Z7D7E4Z7ZPEXDYE7GUVB245NA, seg_pos={0 0}, upload=137773]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 14 05:40:06.164512856 (132h14m28.123610112s) [seg_pos={0 0}, upload=137773]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 05:40:06.164602782 (132h14m28.123700038s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 05:40:06.164609143 (132h14m28.123706402s) [upload=137773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 05:40:06.314970746 (132h14m28.274068101s) [upload=137773]: Done uploading segments...
Aug 14 05:40:06.315012979 (132h14m28.274110232s) [upload=137773]: Upload finished. err: <nil>
Duration: 2.561668919s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|