Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 806.548459ms FAIL (2025-08-09 09:41:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 806.596358ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.X.................................................] duration: 2.374602492s FAIL (2025-08-09 09:41:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.374636547s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.X................................................] duration: 2.369517728s FAIL (2025-08-09 09:41:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.369545286s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 846.395205ms FAIL (2025-08-09 09:40:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 846.423522ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.X...............................................] duration: 2.468139477s FAIL (2025-08-09 09:40:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.4681688s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X.X..............................................] duration: 2.475565819s FAIL (2025-08-09 09:40:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.475598007s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 870.825721ms FAIL (2025-08-09 09:40:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 870.883567ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 843.183011ms FAIL (2025-08-09 09:39:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 843.227666ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X.X.............................................] duration: 2.592020504s FAIL (2025-08-09 09:39:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.59206437s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.080410787s FAIL (2025-08-09 09:38:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.080438382s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X.X............................................] duration: 2.31425171s FAIL (2025-08-09 09:38:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.314292224s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 869.782225ms FAIL (2025-08-09 09:37:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 869.814011ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X.X...........................................] duration: 2.440608131s FAIL (2025-08-09 09:37:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.440688366s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 859.997267ms FAIL (2025-08-09 09:36:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 860.093798ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X.X..........................................] duration: 2.35485194s FAIL (2025-08-09 09:36:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.354894871s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 900.163877ms FAIL (2025-08-09 09:36:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 900.203389ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X.X.........................................] duration: 2.335008086s FAIL (2025-08-09 09:35:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.33503733s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 864.048374ms FAIL (2025-08-09 09:35:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 864.080395ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X.X........................................] duration: 2.421321353s FAIL (2025-08-09 09:35:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.421422347s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X.X.......................................] duration: 2.343560369s FAIL (2025-08-09 09:34:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.343587745s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 838.402678ms FAIL (2025-08-09 09:34:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 838.437384ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X.X......................................] duration: 2.468794391s FAIL (2025-08-09 09:33:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.468847486s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X.X.....................................] duration: 2.35735973s FAIL (2025-08-09 09:33:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.357394352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.X....................................] duration: 2.472787911s FAIL (2025-08-09 09:33:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.472820009s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 833.159189ms FAIL (2025-08-09 09:33:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 833.191868ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X.X...................................] duration: 2.404382884s FAIL (2025-08-09 09:32:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.404419115s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.327596224s FAIL (2025-08-09 09:32:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.327635636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X......................X.X..................................] duration: 2.334730977s FAIL (2025-08-09 09:31:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.334762603s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 832.697374ms FAIL (2025-08-09 09:30:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 832.728367ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X......................X.X.................................] duration: 2.555562963s FAIL (2025-08-09 09:30:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.555592359s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 946.388035ms FAIL (2025-08-09 09:30:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 946.41387ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 842.643483ms FAIL (2025-08-09 09:29:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 842.671387ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X......................X.X................................] duration: 2.492616008s FAIL (2025-08-09 09:29:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.492647123s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 364.113628ms FAIL (2025-08-09 09:29:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 09:29:17.496558598 (16h3m39.455655843s) [upload=16712]: Starting upload Aug 9 09:29:17.496610187 (16h3m39.455707436s) [upload=16712]: Done starting upload Aug 9 09:29:17.496714883 (16h3m39.455812121s) [upload=16712]: Uploading segments... Aug 9 09:29:17.496759594 (16h3m39.455856848s) [upload=16712]: Got next segment. Inline: true Aug 9 09:29:17.496779399 (16h3m39.455876645s) [upload=16712]: Waiting for error group managing segments... Aug 9 09:29:17.496830166 (16h3m39.455927411s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:29:17.496835373 (16h3m39.455932618s) [upload=16712]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 09:29:17.496838992 (16h3m39.455936238s) [upload=16712]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:29:17.586318348 (16h3m39.545415596s) [upload=16712]: Done uploading segments... Aug 9 09:29:17.586338262 (16h3m39.545435514s) [upload=16712]: Upload finished. err: metaclient: Too Many Requests Duration:* 364.134728ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X......................X.X...............................] duration: 2.452339704s FAIL (2025-08-09 09:28:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.452373745s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X......................X.X..............................] duration: 2.680346047s FAIL (2025-08-09 09:28:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.680405822s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X......................X.X.............................] duration: 2.416867025s FAIL (2025-08-09 09:28:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.416899933s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X......................X.X............................] duration: 2.348359312s FAIL (2025-08-09 09:27:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.348393562s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 963.839743ms FAIL (2025-08-09 09:27:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 963.942415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X......................X.X...........................] duration: 2.324308634s FAIL (2025-08-09 09:26:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.324339954s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 841.831874ms FAIL (2025-08-09 09:26:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 841.87418ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X......................X.X..........................] duration: 2.30515852s FAIL (2025-08-09 09:26:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.305190669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 857.763782ms FAIL (2025-08-09 09:25:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 857.796493ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X......................X.X.........................] duration: 2.40399822s FAIL (2025-08-09 09:25:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.404034272s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X......................X.X........................] duration: 2.45891066s FAIL (2025-08-09 09:24:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.458961616s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 842.732066ms FAIL (2025-08-09 09:24:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 842.757994ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X......................X.X.......................] duration: 2.352977949s FAIL (2025-08-09 09:24:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.353011404s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 861.573545ms FAIL (2025-08-09 09:24:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 861.605184ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X......................X.X......................] duration: 2.530823486s FAIL (2025-08-09 09:24:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 9 09:09:44.746250704 (15h44m6.70534795s) [upload=16356]: Starting upload Aug 9 09:09:44.746313302 (15h44m6.705410546s) [upload=16356]: Done starting upload Aug 9 09:09:44.746443457 (15h44m6.705540694s) [upload=16356]: Uploading segments... Aug 9 09:09:44.746714382 (15h44m6.705811628s) [upload=16356]: Got next segment. Inline: false Aug 9 09:09:44.746769613 (15h44m6.705866849s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 09:09:44.746775387 (15h44m6.705872622s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 09:09:44.943377054 (15h44m6.902474299s) [seg_pos={0 0}, upload=16356]: Begin upload segment... Aug 9 09:09:44.943427325 (15h44m6.902524571s) [seg_pos={0 0}, upload=16356]: Done begin upload segment. Aug 9 09:09:44.943463828 (15h44m6.902561082s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.943622852 (15h44m6.902720098s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944145959 (15h44m6.903243214s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944232500 (15h44m6.903329745s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944638655 (15h44m6.903735903s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.944710140 (15h44m6.903807384s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945202101 (15h44m6.904299354s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945278746 (15h44m6.904375991s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.945750446 (15h44m6.904847704s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946092514 (15h44m6.905189759s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946810458 (15h44m6.905907705s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.946913439 (15h44m6.906010688s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947368585 (15h44m6.90646582s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947598429 (15h44m6.906695693s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.947895735 (15h44m6.906992986s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.948376846 (15h44m6.907474094s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949587544 (15h44m6.908684795s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:44.949946752 (15h44m6.909043999s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Uploading piece... Aug 9 09:09:45.499261326 (15h44m7.45835858s) [upload=16356]: Next returned nil segment Aug 9 09:09:45.499286848 (15h44m7.4583841s) [upload=16356]: Waiting for error group managing segments... Aug 9 09:09:45.666721969 (15h44m7.625819215s) [noise=true , address=77.90.31.11:4586 , piece_id=KY3UHEHSCEWIUDQGJ5SOUQ44ROUTKIPN2N36WQ5OSO6GA2CSR2MQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.670946282 (15h44m7.630043527s) [noise=true , address=104.36.82.9:4021 , piece_id=PMGC23OB3YYYGYFUSM3YAFIKDJTJ5H2MYUHVGRUDD5PDRK7257AQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.672125701 (15h44m7.631222951s) [noise=true , address=104.36.82.46:4512 , piece_id=OIYP35OEVSY3WRRITFVNNHBDUNO3QNEIW5RHDKB26K4WUS6CQKFQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.676726530 (15h44m7.635823776s) [noise=true , address=104.36.82.16:4310 , piece_id=GHFJIGZYGGVS5T56NNTOW2QKMSYRYBSNB2TUA7G7HRFLILULFHMQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.680796612 (15h44m7.63989386s) [noise=true , address=104.36.82.59:4330 , piece_id=RVPQNSEOKZC7SQCJLCYNZJNUX7TOJ3VAG7YKNDSPCN3CULJBDRTQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.682779658 (15h44m7.641876895s) [noise=true , address=104.36.82.4:4835 , piece_id=BTGIWLOO6OPN3O5D2I6SC52SPS26PTKIS46X7H2OMHSY3SSKCUFA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.686560377 (15h44m7.645657627s) [noise=true , address=104.36.82.17:4345 , piece_id=PWMF764PHMRFX3NBSUHLUEGLLPTBQP2DZMB5UNGGKOB7NDGFWMWA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.688432117 (15h44m7.647529363s) [noise=true , address=104.36.82.58:4292 , piece_id=UIZE2QDBOLUD5FCUN2KKWAPUBD7SEVGS35K3OH5YNLGUDVT4XZSQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.693450513 (15h44m7.65254776s) [noise=true , address=104.36.82.5:4841 , piece_id=LBWXF5ID2MSPBDFW3DCSR5GPRSXLENXGWK3LFAIRJMQFFEOS77FA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.696697061 (15h44m7.655794297s) [noise=true , address=104.36.82.62:4434 , piece_id=AQEDKI3VNOO2KQ2TORCHNOW2OIKYCVSFFST6UXJFY5TTDOJ4S7QQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.697429970 (15h44m7.656527219s) [noise=true , address=104.36.82.42:4814 , piece_id=ZXJBGHSV2YX55TOHOVM2F62KPHMVKUQPGTJHRQUZCUJWYDEWE26Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.698901320 (15h44m7.657998555s) [noise=true , address=104.36.82.39:4759 , piece_id=7DY2NTJOAD2TYXOVK5OQ66YJ2NJIY2SKF6WSBF4G3KRLUEMGBWOA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.720727240 (15h44m7.679824488s) [noise=true , address=104.36.82.44:4882 , piece_id=DZJE2MOFRRMWWLTXJ3MM4BMPCQCKDTD24ZKWZFYN5LWZ4DAZ656A, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750336352 (15h44m7.709433588s) [noise=true , address=104.36.82.18:4398 , piece_id=P7EX5IKIEYHDAARI6T542SXFGRTD2LMJVQQJQTISDHCHPNVXENQA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: <nil> Aug 9 09:09:45.750363396 (15h44m7.709460642s) [seg_pos={0 0}, upload=16356]: Segment reached optimal threshold of 14 pieces. Aug 9 09:09:45.750797596 (15h44m7.709894836s) [noise=true , address=104.36.82.9:4019 , piece_id=GZYUEC7P6E7RMVQYEDIEOZ2TPRHNJLBGBMHM3DADYXWZV5H5VF4Q, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JuQKLQnXiEcyCj6xthEXSPy2Wu5T1B9m4q9YteoK69rMqVydD): protocol: expected piece hash; context canceled; EOF Aug 9 09:09:45.751063422 (15h44m7.710160657s) [noise=true , address=64.49.13.27:4963 , piece_id=TOLPIELDA6CAZPQQPCD3IWY2HQIGXHXUSCWOZPCJQKXGIFLJA3UQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n6MUXcUQ7sT61AwvkhYRq4wniRMQDWMfFk1tENVSnUiDx38rq): protocol: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41448->64.49.13.27:4963: use of closed network connection Aug 9 09:09:45.751250389 (15h44m7.710347627s) [noise=true , address=64.49.13.140:4509 , piece_id=K6VQCFDF6W5VARETEE7W6LLZYGESV5OJKT4W5VGG2U3VE7NAQXYA, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40052->64.49.13.140:4509: use of closed network connection Aug 9 09:09:45.751280499 (15h44m7.710377734s) [noise=true , address=193.149.164.143:4697 , piece_id=I52PD4W2PIP2DDKACCI7OGPZTG732ZLQCQ2UKOXAIKVMVZ65CZXQ, seg_pos={0 0}, upload=16356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16BjXZvkSyZbchwbLZpL5b4sJDvoUmaxNXsMu9j2Bhcx4WBrjJ): protocol: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49396->193.149.164.143:4697: use of closed network connection Aug 9 09:09:45.751298633 (15h44m7.710395868s) [seg_pos={0 0}, upload=16356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 09:09:45.751403747 (15h44m7.710500993s) [upload=16356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 09:09:45.751408633 (15h44m7.710505879s) [upload=16356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 09:09:45.920706365 (15h44m7.879803616s) [upload=16356]: Done uploading segments... Aug 9 09:09:45.920732636 (15h44m7.879829883s) [upload=16356]: Upload finished. err: <nil> Duration: 2.530876249s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 844.698809ms FAIL (2025-08-09 09:23:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 08:41:45.094986515 (15h16m7.054083761s) [upload=15880]: Starting upload Aug 9 08:41:45.095037538 (15h16m7.054134783s) [upload=15880]: Done starting upload Aug 9 08:41:45.095117159 (15h16m7.054214404s) [upload=15880]: Uploading segments... Aug 9 08:41:45.095175338 (15h16m7.054272593s) [upload=15880]: Got next segment. Inline: true Aug 9 08:41:45.095180931 (15h16m7.054278179s) [upload=15880]: Waiting for error group managing segments... Aug 9 08:41:45.095234207 (15h16m7.054331453s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 08:41:45.095241903 (15h16m7.054339149s) [upload=15880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 08:41:45.095245686 (15h16m7.054342932s) [upload=15880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 08:41:45.263886833 (15h16m7.222984079s) [upload=15880]: Done uploading segments... Aug 9 08:41:45.263905737 (15h16m7.223002983s) [upload=15880]: Upload finished. err: metaclient: Too Many Requests Duration:* 844.740107ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)