Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X......................X.X.....................] duration: 2.359282755s FAIL (2025-08-09 09:23:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.359315031s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X......................X.X....................] duration: 2.73498541s FAIL (2025-08-09 09:23:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.735019046s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 986.663043ms FAIL (2025-08-09 09:22:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 986.708082ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X......................X.X...................] duration: 2.448165406s FAIL (2025-08-09 09:22:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.448194127s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 860.273557ms FAIL (2025-08-09 09:21:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 860.358718ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X......................X.X..................] duration: 2.310188054s FAIL (2025-08-09 09:21:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.310217481s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X......................X.X.................] duration: 2.370280317s FAIL (2025-08-09 09:20:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.370309622s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 825.121348ms FAIL (2025-08-09 09:20:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 825.155173ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X......................X.X................] duration: 2.51689336s FAIL (2025-08-09 09:20:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.516955194s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 879.065894ms FAIL (2025-08-09 09:20:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 879.100834ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X......................X.X...............] duration: 2.370272223s FAIL (2025-08-09 09:19:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.370304866s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 847.987672ms FAIL (2025-08-09 09:19:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 848.023482ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X......................X.X..............] duration: 2.47092471s FAIL (2025-08-09 09:19:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.470967394s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 852.668628ms FAIL (2025-08-09 09:19:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 852.701014ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X......................X.X.............] duration: 2.415750203s FAIL (2025-08-09 09:19:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.415814724s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 818.331797ms FAIL (2025-08-09 09:18:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 818.363744ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X......................X.X............] duration: 2.36625378s FAIL (2025-08-09 09:18:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.366283316s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.299210274s FAIL (2025-08-09 09:17:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.299237542s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X......................X.X...........] duration: 2.34728365s FAIL (2025-08-09 09:17:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.347314614s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X......................X.X..........] duration: 2.388603668s FAIL (2025-08-09 09:17:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.388660574s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 865.198844ms FAIL (2025-08-09 09:16:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 865.229988ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X......................X.X.........] duration: 2.490438883s FAIL (2025-08-09 09:16:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.490483806s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 876.333597ms FAIL (2025-08-09 09:16:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 876.39203ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X......................X.X........] duration: 2.432218924s FAIL (2025-08-09 09:15:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.432270912s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X..........................X......................X.X.......] duration: 2.238688323s FAIL (2025-08-09 09:15:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.2387209s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 826.555012ms FAIL (2025-08-09 09:15:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 826.588269ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 884.119703ms FAIL (2025-08-09 09:14:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 884.15017ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X..........................X......................X.X......] duration: 2.339528486s FAIL (2025-08-09 09:14:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.339616993s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 872.656893ms FAIL (2025-08-09 09:14:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 872.68919ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 825.674123ms FAIL (2025-08-09 09:13:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 825.700253ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X..........................X......................X.X.....] duration: 2.352894289s FAIL (2025-08-09 09:13:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.35292945s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 859.336213ms FAIL (2025-08-09 09:12:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 859.372798ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X..........................X......................X.X....] duration: 2.342620223s FAIL (2025-08-09 09:12:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.342679741s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 804.651824ms FAIL (2025-08-09 09:11:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 804.679487ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 996.895252ms FAIL (2025-08-09 09:11:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 996.920765ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X..........................X......................X.X...] duration: 2.329264818s FAIL (2025-08-09 09:11:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.32930406s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X..........................X......................X.X..] duration: 2.364759523s FAIL (2025-08-09 09:11:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.364794146s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X..........................X......................X.X.] duration: 2.315087582s FAIL (2025-08-09 09:10:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.315118465s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 851.290771ms FAIL (2025-08-09 09:10:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 851.321849ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 874.908194ms FAIL (2025-08-09 09:10:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 874.932974ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X..........................X......................X.X] duration: 1.667979171s FAIL (2025-08-09 09:09:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 1.66800977s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 990.936533ms FAIL (2025-08-09 09:09:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 991.015497ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 822.834152ms FAIL (2025-08-09 09:08:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 822.866473ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X..........................X......................X.] duration: 2.369248456s FAIL (2025-08-09 09:08:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 09:07:29.797095189 (15h41m51.756192429s) [upload=16321]: Starting upload Aug 9 09:07:29.797168784 (15h41m51.756266025s) [upload=16321]: Done starting upload Aug 9 09:07:29.797409715 (15h41m51.756506954s) [upload=16321]: Uploading segments... Aug 9 09:07:29.798676545 (15h41m51.757773795s) [upload=16321]: Got next segment. Inline: false Aug 9 09:07:29.798748105 (15h41m51.757845351s) [upload=16321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:07:29.798753971 (15h41m51.757851218s) [upload=16321]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:07:29.995816589 (15h41m51.954913834s) [seg_pos={0 0}, upload=16321]: Begin upload segment... Aug 9 09:07:29.995895913 (15h41m51.954993165s) [noise=true , address=104.36.82.16:4316 , piece_id=CTEBKLTY2NZQ422Y3H26H2GZZDHWPDHSCAFZ5X7N6UJZ2XV35ZGA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.996501563 (15h41m51.955598814s) [noise=true , address=104.36.82.44:4904 , piece_id=7FSYYL2FWXUTH6N72GVD3CNVTBNE32HITMP5N3IPZREY744N23VA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.997229616 (15h41m51.956326864s) [seg_pos={0 0}, upload=16321]: Done begin upload segment. Aug 9 09:07:29.997286710 (15h41m51.956383966s) [noise=true , address=104.36.82.39:4744 , piece_id=ZPAA743TQ2FHTCS4CWPVAQ5ATU7EZBOPLBYVXNYO3DHY6ESIA7TA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.997806169 (15h41m51.956903418s) [noise=true , address=104.36.82.9:4015 , piece_id=6C4EX4LT5R2VWSM2NBO3SW5XDLTJRPOZ46PALMGFZXUJZO44R5VQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.997999273 (15h41m51.957096522s) [noise=true , address=45.91.116.9:4269 , piece_id=MMVUNN5JTY7OREPCXNMCL4NSJBA7P6VJIJHHJ2NAXFBSY5TVC33A, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.998679995 (15h41m51.957777251s) [noise=true , address=104.36.82.18:4368 , piece_id=TFWH2WPCSSFCHUDYQ3FZFXI3L36WJOCDEQPQCRNNNCHKWJX7YEDA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.999269498 (15h41m51.958366747s) [noise=true , address=104.36.82.36:4633 , piece_id=KBCLG7IM3HQ76N3HBB7RZW3GVTKK2D4COFR2YAHAH35JTH66ENXA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.999728617 (15h41m51.958825869s) [noise=true , address=64.49.13.140:4511 , piece_id=FAOZNX6HJPQOQTTDUVIXYSBQ7WKFV6VDDQMJQ2SSOYBLNTDH3CDQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.000184721 (15h41m51.959282003s) [noise=true , address=64.49.13.138:4486 , piece_id=KLQZ2OS2KV2UWN5IOWZEQQISYYIHAOVMSXYFN5F2PBNB4IQLETDA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.000657969 (15h41m51.959755241s) [noise=true , address=104.36.82.40:4942 , piece_id=VIOJJ64LMNLQ64TSULJWJ37ZJ4IZZQ2B7XIVZG7QP74OT7V5CRJA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.001075008 (15h41m51.960172257s) [noise=true , address=104.36.82.61:4392 , piece_id=YA6YN2IQDW5EZE3UXS4TG7RH7UFQZ67H4LTQ7ISWKM2MVXAVATRA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.001501624 (15h41m51.960598897s) [noise=true , address=104.36.82.5:4859 , piece_id=72D3O52TM6FSUUPVUPLUFUIY3VWUVFHK3VNXZIUJY5TECALWZPZQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.002317104 (15h41m51.961414358s) [noise=true , address=104.36.82.12:4154 , piece_id=GEBUFATUJ4RBEE4UM7P6TD3JDH6WY5XBQNQXSNMZDHT7B4RO5CQQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.002531387 (15h41m51.961628644s) [noise=true , address=104.36.82.58:4273 , piece_id=BUT5GCCVIQMLTILHVDITIWLONOY6ZJVTZ4MFVBYKWSPWMLRX4Y6Q, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.003145184 (15h41m51.962242439s) [noise=true , address=104.36.82.62:4442 , piece_id=LFJH25VYIV3RLHNHECWH7DADTCWNSU5IHYE2Y4NXOTVFF7I62ONA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.003675447 (15h41m51.962772704s) [noise=true , address=104.36.82.60:4370 , piece_id=OJL54NTP2SGSZBZFQW6PI3OPEVFJDVWIVIQC5L3U57LMSDB37WKA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.004033570 (15h41m51.963130828s) [noise=true , address=104.36.82.38:4696 , piece_id=7CMZ3LLNNEFLB3OEW4TR5HABQDGJTZSYN6KOIBXJXU5GS44BZO7Q, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.004455244 (15h41m51.9635525s) [noise=true , address=45.91.116.12:4253 , piece_id=KGOMETLECBEXK7WFZNBFMS7GCZSGDXJBK2XK55JUFHJD7ZVVAGHA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.576494928 (15h41m52.535592175s) [upload=16321]: Next returned nil segment Aug 9 09:07:30.576520983 (15h41m52.535618238s) [upload=16321]: Waiting for error group managing segments... Aug 9 09:07:30.724820227 (15h41m52.683917463s) [noise=true , address=45.91.116.9:4269 , piece_id=MMVUNN5JTY7OREPCXNMCL4NSJBA7P6VJIJHHJ2NAXFBSY5TVC33A, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.727925645 (15h41m52.687022884s) [noise=true , address=104.36.82.39:4744 , piece_id=ZPAA743TQ2FHTCS4CWPVAQ5ATU7EZBOPLBYVXNYO3DHY6ESIA7TA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.729156851 (15h41m52.688254085s) [noise=true , address=104.36.82.40:4942 , piece_id=VIOJJ64LMNLQ64TSULJWJ37ZJ4IZZQ2B7XIVZG7QP74OT7V5CRJA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.732445038 (15h41m52.691542292s) [noise=true , address=104.36.82.16:4316 , piece_id=CTEBKLTY2NZQ422Y3H26H2GZZDHWPDHSCAFZ5X7N6UJZ2XV35ZGA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.736557990 (15h41m52.695655243s) [noise=true , address=104.36.82.44:4904 , piece_id=7FSYYL2FWXUTH6N72GVD3CNVTBNE32HITMP5N3IPZREY744N23VA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.740530040 (15h41m52.699627283s) [noise=true , address=45.91.116.12:4253 , piece_id=KGOMETLECBEXK7WFZNBFMS7GCZSGDXJBK2XK55JUFHJD7ZVVAGHA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.740943480 (15h41m52.700040733s) [noise=true , address=104.36.82.5:4859 , piece_id=72D3O52TM6FSUUPVUPLUFUIY3VWUVFHK3VNXZIUJY5TECALWZPZQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.744932183 (15h41m52.704029422s) [noise=true , address=104.36.82.62:4442 , piece_id=LFJH25VYIV3RLHNHECWH7DADTCWNSU5IHYE2Y4NXOTVFF7I62ONA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.751132119 (15h41m52.710229355s) [noise=true , address=104.36.82.18:4368 , piece_id=TFWH2WPCSSFCHUDYQ3FZFXI3L36WJOCDEQPQCRNNNCHKWJX7YEDA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.751372044 (15h41m52.710469285s) [noise=true , address=104.36.82.12:4154 , piece_id=GEBUFATUJ4RBEE4UM7P6TD3JDH6WY5XBQNQXSNMZDHT7B4RO5CQQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.754607683 (15h41m52.713704937s) [noise=true , address=104.36.82.58:4273 , piece_id=BUT5GCCVIQMLTILHVDITIWLONOY6ZJVTZ4MFVBYKWSPWMLRX4Y6Q, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.758416845 (15h41m52.71751408s) [noise=true , address=104.36.82.61:4392 , piece_id=YA6YN2IQDW5EZE3UXS4TG7RH7UFQZ67H4LTQ7ISWKM2MVXAVATRA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.763993267 (15h41m52.723090513s) [noise=true , address=104.36.82.9:4015 , piece_id=6C4EX4LT5R2VWSM2NBO3SW5XDLTJRPOZ46PALMGFZXUJZO44R5VQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.766345439 (15h41m52.725442686s) [noise=true , address=104.36.82.60:4370 , piece_id=OJL54NTP2SGSZBZFQW6PI3OPEVFJDVWIVIQC5L3U57LMSDB37WKA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.766396089 (15h41m52.725493335s) [seg_pos={0 0}, upload=16321]: Segment reached optimal threshold of 14 pieces. Aug 9 09:07:30.766723196 (15h41m52.725820431s) [noise=true , address=104.36.82.36:4633 , piece_id=KBCLG7IM3HQ76N3HBB7RZW3GVTKK2D4COFR2YAHAH35JTH66ENXA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 9 09:07:30.766855656 (15h41m52.725952894s) [noise=true , address=104.36.82.38:4696 , piece_id=7CMZ3LLNNEFLB3OEW4TR5HABQDGJTZSYN6KOIBXJXU5GS44BZO7Q, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H): protocol: expected piece hash; context canceled; EOF Aug 9 09:07:30.766934420 (15h41m52.726031659s) [noise=true , address=64.49.13.138:4486 , piece_id=KLQZ2OS2KV2UWN5IOWZEQQISYYIHAOVMSXYFN5F2PBNB4IQLETDA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: write tcp 139.59.144.22:32918->64.49.13.138:4486: use of closed network connection; write tcp 139.59.144.22:32918->64.49.13.138:4486: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32918->64.49.13.138:4486: use of closed network connection Aug 9 09:07:30.767117469 (15h41m52.726214715s) [noise=true , address=64.49.13.140:4511 , piece_id=FAOZNX6HJPQOQTTDUVIXYSBQ7WKFV6VDDQMJQ2SSOYBLNTDH3CDQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:37986->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:37986->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37986->64.49.13.140:4511: use of closed network connection Aug 9 09:07:30.767162407 (15h41m52.726259646s) [seg_pos={0 0}, upload=16321]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:07:30.767251474 (15h41m52.726348723s) [upload=16321]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:07:30.767256598 (15h41m52.726353843s) [upload=16321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:07:30.936706522 (15h41m52.895803761s) [upload=16321]: Done uploading segments... Aug 9 09:07:30.936729300 (15h41m52.895826539s) [upload=16321]: Upload finished. err: <nil> Duration: 2.369274434s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 833.709674ms FAIL (2025-08-09 09:08:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 833.738986ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X..........................X......................X] duration: 1.786853611s FAIL (2025-08-09 09:07:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 09:07:29.797095189 (15h41m51.756192429s) [upload=16321]: Starting upload Aug 9 09:07:29.797168784 (15h41m51.756266025s) [upload=16321]: Done starting upload Aug 9 09:07:29.797409715 (15h41m51.756506954s) [upload=16321]: Uploading segments... Aug 9 09:07:29.798676545 (15h41m51.757773795s) [upload=16321]: Got next segment. Inline: false Aug 9 09:07:29.798748105 (15h41m51.757845351s) [upload=16321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:07:29.798753971 (15h41m51.757851218s) [upload=16321]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:07:29.995816589 (15h41m51.954913834s) [seg_pos={0 0}, upload=16321]: Begin upload segment... Aug 9 09:07:29.995895913 (15h41m51.954993165s) [noise=true , address=104.36.82.16:4316 , piece_id=CTEBKLTY2NZQ422Y3H26H2GZZDHWPDHSCAFZ5X7N6UJZ2XV35ZGA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.996501563 (15h41m51.955598814s) [noise=true , address=104.36.82.44:4904 , piece_id=7FSYYL2FWXUTH6N72GVD3CNVTBNE32HITMP5N3IPZREY744N23VA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.997229616 (15h41m51.956326864s) [seg_pos={0 0}, upload=16321]: Done begin upload segment. Aug 9 09:07:29.997286710 (15h41m51.956383966s) [noise=true , address=104.36.82.39:4744 , piece_id=ZPAA743TQ2FHTCS4CWPVAQ5ATU7EZBOPLBYVXNYO3DHY6ESIA7TA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.997806169 (15h41m51.956903418s) [noise=true , address=104.36.82.9:4015 , piece_id=6C4EX4LT5R2VWSM2NBO3SW5XDLTJRPOZ46PALMGFZXUJZO44R5VQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.997999273 (15h41m51.957096522s) [noise=true , address=45.91.116.9:4269 , piece_id=MMVUNN5JTY7OREPCXNMCL4NSJBA7P6VJIJHHJ2NAXFBSY5TVC33A, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.998679995 (15h41m51.957777251s) [noise=true , address=104.36.82.18:4368 , piece_id=TFWH2WPCSSFCHUDYQ3FZFXI3L36WJOCDEQPQCRNNNCHKWJX7YEDA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.999269498 (15h41m51.958366747s) [noise=true , address=104.36.82.36:4633 , piece_id=KBCLG7IM3HQ76N3HBB7RZW3GVTKK2D4COFR2YAHAH35JTH66ENXA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:29.999728617 (15h41m51.958825869s) [noise=true , address=64.49.13.140:4511 , piece_id=FAOZNX6HJPQOQTTDUVIXYSBQ7WKFV6VDDQMJQ2SSOYBLNTDH3CDQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.000184721 (15h41m51.959282003s) [noise=true , address=64.49.13.138:4486 , piece_id=KLQZ2OS2KV2UWN5IOWZEQQISYYIHAOVMSXYFN5F2PBNB4IQLETDA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.000657969 (15h41m51.959755241s) [noise=true , address=104.36.82.40:4942 , piece_id=VIOJJ64LMNLQ64TSULJWJ37ZJ4IZZQ2B7XIVZG7QP74OT7V5CRJA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.001075008 (15h41m51.960172257s) [noise=true , address=104.36.82.61:4392 , piece_id=YA6YN2IQDW5EZE3UXS4TG7RH7UFQZ67H4LTQ7ISWKM2MVXAVATRA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.001501624 (15h41m51.960598897s) [noise=true , address=104.36.82.5:4859 , piece_id=72D3O52TM6FSUUPVUPLUFUIY3VWUVFHK3VNXZIUJY5TECALWZPZQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.002317104 (15h41m51.961414358s) [noise=true , address=104.36.82.12:4154 , piece_id=GEBUFATUJ4RBEE4UM7P6TD3JDH6WY5XBQNQXSNMZDHT7B4RO5CQQ, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.002531387 (15h41m51.961628644s) [noise=true , address=104.36.82.58:4273 , piece_id=BUT5GCCVIQMLTILHVDITIWLONOY6ZJVTZ4MFVBYKWSPWMLRX4Y6Q, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.003145184 (15h41m51.962242439s) [noise=true , address=104.36.82.62:4442 , piece_id=LFJH25VYIV3RLHNHECWH7DADTCWNSU5IHYE2Y4NXOTVFF7I62ONA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.003675447 (15h41m51.962772704s) [noise=true , address=104.36.82.60:4370 , piece_id=OJL54NTP2SGSZBZFQW6PI3OPEVFJDVWIVIQC5L3U57LMSDB37WKA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.004033570 (15h41m51.963130828s) [noise=true , address=104.36.82.38:4696 , piece_id=7CMZ3LLNNEFLB3OEW4TR5HABQDGJTZSYN6KOIBXJXU5GS44BZO7Q, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.004455244 (15h41m51.9635525s) [noise=true , address=45.91.116.12:4253 , piece_id=KGOMETLECBEXK7WFZNBFMS7GCZSGDXJBK2XK55JUFHJD7ZVVAGHA, seg_pos={0 0}, upload=16321]: Uploading piece... Aug 9 09:07:30.576494928 (15h41m52.535592175s) [upload=16321]: Next returned nil segment Aug 9 09:07:30.576520983 (15h41m52.535618238s) [upload=16321]: Waiting for error group managing segments... Aug 9 09:07:30.724820227 (15h41m52.683917463s) [noise=true , address=45.91.116.9:4269 , piece_id=MMVUNN5JTY7OREPCXNMCL4NSJBA7P6VJIJHHJ2NAXFBSY5TVC33A, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.727925645 (15h41m52.687022884s) [noise=true , address=104.36.82.39:4744 , piece_id=ZPAA743TQ2FHTCS4CWPVAQ5ATU7EZBOPLBYVXNYO3DHY6ESIA7TA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.729156851 (15h41m52.688254085s) [noise=true , address=104.36.82.40:4942 , piece_id=VIOJJ64LMNLQ64TSULJWJ37ZJ4IZZQ2B7XIVZG7QP74OT7V5CRJA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.732445038 (15h41m52.691542292s) [noise=true , address=104.36.82.16:4316 , piece_id=CTEBKLTY2NZQ422Y3H26H2GZZDHWPDHSCAFZ5X7N6UJZ2XV35ZGA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.736557990 (15h41m52.695655243s) [noise=true , address=104.36.82.44:4904 , piece_id=7FSYYL2FWXUTH6N72GVD3CNVTBNE32HITMP5N3IPZREY744N23VA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.740530040 (15h41m52.699627283s) [noise=true , address=45.91.116.12:4253 , piece_id=KGOMETLECBEXK7WFZNBFMS7GCZSGDXJBK2XK55JUFHJD7ZVVAGHA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.740943480 (15h41m52.700040733s) [noise=true , address=104.36.82.5:4859 , piece_id=72D3O52TM6FSUUPVUPLUFUIY3VWUVFHK3VNXZIUJY5TECALWZPZQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.744932183 (15h41m52.704029422s) [noise=true , address=104.36.82.62:4442 , piece_id=LFJH25VYIV3RLHNHECWH7DADTCWNSU5IHYE2Y4NXOTVFF7I62ONA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.751132119 (15h41m52.710229355s) [noise=true , address=104.36.82.18:4368 , piece_id=TFWH2WPCSSFCHUDYQ3FZFXI3L36WJOCDEQPQCRNNNCHKWJX7YEDA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.751372044 (15h41m52.710469285s) [noise=true , address=104.36.82.12:4154 , piece_id=GEBUFATUJ4RBEE4UM7P6TD3JDH6WY5XBQNQXSNMZDHT7B4RO5CQQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.754607683 (15h41m52.713704937s) [noise=true , address=104.36.82.58:4273 , piece_id=BUT5GCCVIQMLTILHVDITIWLONOY6ZJVTZ4MFVBYKWSPWMLRX4Y6Q, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.758416845 (15h41m52.71751408s) [noise=true , address=104.36.82.61:4392 , piece_id=YA6YN2IQDW5EZE3UXS4TG7RH7UFQZ67H4LTQ7ISWKM2MVXAVATRA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.763993267 (15h41m52.723090513s) [noise=true , address=104.36.82.9:4015 , piece_id=6C4EX4LT5R2VWSM2NBO3SW5XDLTJRPOZ46PALMGFZXUJZO44R5VQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.766345439 (15h41m52.725442686s) [noise=true , address=104.36.82.60:4370 , piece_id=OJL54NTP2SGSZBZFQW6PI3OPEVFJDVWIVIQC5L3U57LMSDB37WKA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: <nil> Aug 9 09:07:30.766396089 (15h41m52.725493335s) [seg_pos={0 0}, upload=16321]: Segment reached optimal threshold of 14 pieces. Aug 9 09:07:30.766723196 (15h41m52.725820431s) [noise=true , address=104.36.82.36:4633 , piece_id=KBCLG7IM3HQ76N3HBB7RZW3GVTKK2D4COFR2YAHAH35JTH66ENXA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 9 09:07:30.766855656 (15h41m52.725952894s) [noise=true , address=104.36.82.38:4696 , piece_id=7CMZ3LLNNEFLB3OEW4TR5HABQDGJTZSYN6KOIBXJXU5GS44BZO7Q, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JrFvHgEHVLtwK3QYvFTzASCysBCR38qA4Ni8Jvrb1rXUaFy3H): protocol: expected piece hash; context canceled; EOF Aug 9 09:07:30.766934420 (15h41m52.726031659s) [noise=true , address=64.49.13.138:4486 , piece_id=KLQZ2OS2KV2UWN5IOWZEQQISYYIHAOVMSXYFN5F2PBNB4IQLETDA, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: write tcp 139.59.144.22:32918->64.49.13.138:4486: use of closed network connection; write tcp 139.59.144.22:32918->64.49.13.138:4486: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:32918->64.49.13.138:4486: use of closed network connection Aug 9 09:07:30.767117469 (15h41m52.726214715s) [noise=true , address=64.49.13.140:4511 , piece_id=FAOZNX6HJPQOQTTDUVIXYSBQ7WKFV6VDDQMJQ2SSOYBLNTDH3CDQ, seg_pos={0 0}, upload=16321]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:37986->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:37986->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37986->64.49.13.140:4511: use of closed network connection Aug 9 09:07:30.767162407 (15h41m52.726259646s) [seg_pos={0 0}, upload=16321]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:07:30.767251474 (15h41m52.726348723s) [upload=16321]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:07:30.767256598 (15h41m52.726353843s) [upload=16321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:07:30.936706522 (15h41m52.895803761s) [upload=16321]: Done uploading segments... Aug 9 09:07:30.936729300 (15h41m52.895826539s) [upload=16321]: Upload finished. err: <nil> Duration: 1.786878611s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 853.264224ms FAIL (2025-08-09 09:07:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 853.294139ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 835.340798ms FAIL (2025-08-09 09:06:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 835.39784ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..........................X......................] duration: 2.351560952s FAIL (2025-08-09 09:06:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 08:49:26.743685689 (15h23m48.702782924s) [upload=16007]: Starting upload Aug 9 08:49:26.743732418 (15h23m48.702829672s) [upload=16007]: Done starting upload Aug 9 08:49:26.743990417 (15h23m48.703087654s) [upload=16007]: Uploading segments... Aug 9 08:49:26.744040895 (15h23m48.70313815s) [upload=16007]: Got next segment. Inline: false Aug 9 08:49:26.744077868 (15h23m48.703175115s) [upload=16007]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:49:26.744083460 (15h23m48.703180706s) [upload=16007]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 08:49:26.944316786 (15h23m48.903414031s) [seg_pos={0 0}, upload=16007]: Begin upload segment... Aug 9 08:49:26.944371440 (15h23m48.903468689s) [seg_pos={0 0}, upload=16007]: Done begin upload segment. Aug 9 08:49:26.944401234 (15h23m48.903498482s) [noise=true , address=104.36.82.16:4313 , piece_id=YERZMVUBDKCSH5Q63UYGFLPCWG734PRN6CZBNJ5BN6NVDNTI72OA, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.944415760 (15h23m48.903512996s) [noise=true , address=104.36.82.16:4325 , piece_id=FKDO5VK32MCIPCBHIPAAG3IXWVO5OU4PK4SJI7HKNMRRW6R5SOGQ, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.944793479 (15h23m48.903890726s) [noise=true , address=104.36.82.62:4431 , piece_id=7UQDU6SNVMRBQ4NFQPR4AYKWNZL7RZC673ZNKWY325CMNIP7RY3Q, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.944936732 (15h23m48.904033984s) [noise=true , address=104.36.82.38:4722 , piece_id=DGWYFCYYJFMAULKVVMK6B3A4PFB6Z63VRSQBMOT3ZVPMXKXESE2A, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.945136285 (15h23m48.904233538s) [noise=true , address=104.36.82.45:4917 , piece_id=VTNQLXRITCAU7YG6DT7HITHTG4Y3BWNMX4VCKVYWFQIJGHXZL5IQ, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.945956063 (15h23m48.905053441s) [noise=true , address=64.49.13.137:4497 , piece_id=YLFE57Q6X5PZKEGRDJW5IHTX45GV6GLAGKBFTHBFGWT6ICXC4J6A, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.946177462 (15h23m48.90527471s) [noise=true , address=104.36.82.19:4431 , piece_id=BFF2MVTAYYEICHIJHPZRYRQYQRAFYDVWQEDVS4K6FEJWUAZPLIAQ, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.946910704 (15h23m48.906007955s) [noise=true , address=104.36.82.36:4625 , piece_id=JYMBQDLHDQKXXLSEWGUMY754IIUPH5COBQ3C3EYO4IBJPJXJGT4Q, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.946998295 (15h23m48.906095546s) [noise=true , address=104.36.82.34:4573 , piece_id=KY4UJDCRZURF3NZGV7HJXDA5PPAV7L2O4UCYBSLMMCX34YMJFLIA, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.947877980 (15h23m48.906975234s) [noise=true , address=104.36.82.37:4659 , piece_id=2NCXAJSGMLUAE4D46JWI6FTUJLORW4VBMU6Q35OJ4DMCLSUR3ZWA, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.947979184 (15h23m48.907076435s) [noise=true , address=104.36.82.13:4188 , piece_id=M5NRNLYBXA5SX6RGSTR3Y4NZTPGZWWVUVL6LTIVPHOHIQUFQGNCA, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.948953778 (15h23m48.908051035s) [noise=true , address=104.36.82.44:4897 , piece_id=VI4POTILK3XDJPZKWOY4F3CM2I7FG3CYGL56FXPIKE7G5RDZQ4RA, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.948999082 (15h23m48.908096331s) [noise=true , address=104.36.82.46:4512 , piece_id=JYOAFSKPEG64WEN4BNRNX2SEJOMLAQ66YY5YEP5CNTUMHATDNNMQ, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.949549789 (15h23m48.908647035s) [noise=true , address=45.91.116.10:4084 , piece_id=OD7264UM3YUMMM2Y5TYYBM4D7MKJAMQLVASK2K77QQSRNQ4BWZ2A, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.949998421 (15h23m48.909095668s) [noise=true , address=104.36.82.6:4881 , piece_id=6OC4UGWJG52AHYOKDZIEOTTER6T3S3ZBAQ7DGVY6QHIXRSEVIQDQ, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.950998232 (15h23m48.910095493s) [noise=true , address=104.36.82.60:4352 , piece_id=D6HFGVCUDJEKF6DUPXV5WHWON5MXXBWCOHBPYQXF7NA6CIVTGVSA, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.951472514 (15h23m48.910569762s) [noise=true , address=104.36.82.22:4523 , piece_id=HIGJ42WHSKLWFJJTBYFZDJ53J5KCKBODI4PEFA362MWRPBV7HPJQ, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:26.951944136 (15h23m48.911041391s) [noise=true , address=104.36.82.58:4275 , piece_id=H7ULUBWFFAPH7IXW6UGBWYDHVNXJTBREXJOXKXP7OKAE5M6V243Q, seg_pos={0 0}, upload=16007]: Uploading piece... Aug 9 08:49:27.520100575 (15h23m49.479197839s) [upload=16007]: Next returned nil segment Aug 9 08:49:27.520130851 (15h23m49.479228096s) [upload=16007]: Waiting for error group managing segments... Aug 9 08:49:27.657666493 (15h23m49.616763724s) [noise=true , address=45.91.116.10:4084 , piece_id=OD7264UM3YUMMM2Y5TYYBM4D7MKJAMQLVASK2K77QQSRNQ4BWZ2A, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.669387627 (15h23m49.628484874s) [noise=true , address=104.36.82.44:4897 , piece_id=VI4POTILK3XDJPZKWOY4F3CM2I7FG3CYGL56FXPIKE7G5RDZQ4RA, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.673970532 (15h23m49.633067779s) [noise=true , address=104.36.82.34:4573 , piece_id=KY4UJDCRZURF3NZGV7HJXDA5PPAV7L2O4UCYBSLMMCX34YMJFLIA, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.676405178 (15h23m49.635502417s) [noise=true , address=104.36.82.13:4188 , piece_id=M5NRNLYBXA5SX6RGSTR3Y4NZTPGZWWVUVL6LTIVPHOHIQUFQGNCA, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.679900463 (15h23m49.638997702s) [noise=true , address=104.36.82.62:4431 , piece_id=7UQDU6SNVMRBQ4NFQPR4AYKWNZL7RZC673ZNKWY325CMNIP7RY3Q, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.681806158 (15h23m49.640903396s) [noise=true , address=104.36.82.16:4313 , piece_id=YERZMVUBDKCSH5Q63UYGFLPCWG734PRN6CZBNJ5BN6NVDNTI72OA, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.687709835 (15h23m49.646807084s) [noise=true , address=104.36.82.37:4659 , piece_id=2NCXAJSGMLUAE4D46JWI6FTUJLORW4VBMU6Q35OJ4DMCLSUR3ZWA, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.689052504 (15h23m49.648149751s) [noise=true , address=104.36.82.45:4917 , piece_id=VTNQLXRITCAU7YG6DT7HITHTG4Y3BWNMX4VCKVYWFQIJGHXZL5IQ, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.694600137 (15h23m49.653697372s) [noise=true , address=104.36.82.46:4512 , piece_id=JYOAFSKPEG64WEN4BNRNX2SEJOMLAQ66YY5YEP5CNTUMHATDNNMQ, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.694964630 (15h23m49.654061869s) [noise=true , address=104.36.82.19:4431 , piece_id=BFF2MVTAYYEICHIJHPZRYRQYQRAFYDVWQEDVS4K6FEJWUAZPLIAQ, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.699453495 (15h23m49.658550733s) [noise=true , address=104.36.82.6:4881 , piece_id=6OC4UGWJG52AHYOKDZIEOTTER6T3S3ZBAQ7DGVY6QHIXRSEVIQDQ, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.699550339 (15h23m49.658647575s) [noise=true , address=104.36.82.22:4523 , piece_id=HIGJ42WHSKLWFJJTBYFZDJ53J5KCKBODI4PEFA362MWRPBV7HPJQ, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.701570687 (15h23m49.660667924s) [noise=true , address=104.36.82.16:4325 , piece_id=FKDO5VK32MCIPCBHIPAAG3IXWVO5OU4PK4SJI7HKNMRRW6R5SOGQ, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.711406591 (15h23m49.670503837s) [noise=true , address=104.36.82.36:4625 , piece_id=JYMBQDLHDQKXXLSEWGUMY754IIUPH5COBQ3C3EYO4IBJPJXJGT4Q, seg_pos={0 0}, upload=16007]: Done uploading piece. err: <nil> Aug 9 08:49:27.711443385 (15h23m49.670540635s) [seg_pos={0 0}, upload=16007]: Segment reached optimal threshold of 14 pieces. Aug 9 08:49:27.711656354 (15h23m49.670753601s) [noise=true , address=104.36.82.58:4275 , piece_id=H7ULUBWFFAPH7IXW6UGBWYDHVNXJTBREXJOXKXP7OKAE5M6V243Q, seg_pos={0 0}, upload=16007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF Aug 9 08:49:27.711722267 (15h23m49.670819499s) [noise=true , address=64.49.13.137:4497 , piece_id=YLFE57Q6X5PZKEGRDJW5IHTX45GV6GLAGKBFTHBFGWT6ICXC4J6A, seg_pos={0 0}, upload=16007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qm8sngG152bw9bzNn2cTN3psYcMBDVbBTewLFPWVhiNhcczkm): protocol: write tcp 139.59.144.22:59072->64.49.13.137:4497: use of closed network connection; write tcp 139.59.144.22:59072->64.49.13.137:4497: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59072->64.49.13.137:4497: use of closed network connection Aug 9 08:49:27.711799933 (15h23m49.670897177s) [noise=true , address=104.36.82.60:4352 , piece_id=D6HFGVCUDJEKF6DUPXV5WHWON5MXXBWCOHBPYQXF7NA6CIVTGVSA, seg_pos={0 0}, upload=16007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RtYD3H9egoiNUbXsxJMWetAHYqjKGtfnGyNLSn6tbugdHaLXi): protocol: expected piece hash; context canceled; EOF Aug 9 08:49:27.711817735 (15h23m49.670914981s) [noise=true , address=104.36.82.38:4722 , piece_id=DGWYFCYYJFMAULKVVMK6B3A4PFB6Z63VRSQBMOT3ZVPMXKXESE2A, seg_pos={0 0}, upload=16007]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zw3dtUg9gARz52KhwDLTjcqC3CNm7dpPzpdx7P7PbL1jwe8uc): protocol: expected piece hash; context canceled; EOF Aug 9 08:49:27.711830985 (15h23m49.670928234s) [seg_pos={0 0}, upload=16007]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 08:49:27.711925842 (15h23m49.671023099s) [upload=16007]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 08:49:27.711932536 (15h23m49.671029795s) [upload=16007]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:49:27.870375403 (15h23m49.829472677s) [upload=16007]: Done uploading segments... Aug 9 08:49:27.870462629 (15h23m49.829559909s) [upload=16007]: Upload finished. err: <nil> Duration: 2.3516475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 997.327394ms FAIL (2025-08-09 09:05:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 997.360709ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)