Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X......................................X........] duration: 2.501895008s FAIL (2025-08-08 08:22:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.501926479s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................................X.......] duration: 2.371299873s FAIL (2025-08-08 08:21:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.371333882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 809.998187ms FAIL (2025-08-08 08:21:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 810.030925ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.............X......................................X......] duration: 2.366462827s FAIL (2025-08-08 08:20:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.36651759s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 852.862176ms FAIL (2025-08-08 08:20:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 852.966259ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.............X......................................X.....] duration: 2.634537635s FAIL (2025-08-08 08:20:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.63457728s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.074303666s FAIL (2025-08-08 08:20:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 1.074356072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.............X......................................X....] duration: 2.403403155s FAIL (2025-08-08 08:19:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.403430959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X......................................................X....] duration: 991.591957ms FAIL (2025-08-08 08:19:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 991.62382ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.............X......................................X...] duration: 2.329450678s FAIL (2025-08-08 08:18:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.329544944s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X......................................................X...] duration: 834.865913ms FAIL (2025-08-08 08:18:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 834.914982ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.............X......................................X..] duration: 2.348618297s FAIL (2025-08-08 08:17:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.348651912s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X......................................................X..] duration: 885.018349ms FAIL (2025-08-08 08:17:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 885.039928ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X......................................................X.] duration: 1.03450215s FAIL (2025-08-08 08:17:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 1.034545773s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.............X......................................X.] duration: 2.292501084s FAIL (2025-08-08 08:16:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.292547685s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X......................................................X] duration: 364.890081ms FAIL (2025-08-08 08:15:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== loading segments... Aug 8 08:09:32.794169624 (22h29m54.538226473s) [upload=23276]: Upload finished. err: <nil> Aug 8 08:10:29.836939612 (22h30m51.580996462s) [upload=23299]: Starting upload Aug 8 08:10:29.837025487 (22h30m51.581082338s) [upload=23299]: Done starting upload Aug 8 08:10:29.837164063 (22h30m51.581220931s) [upload=23299]: Uploading segments... Aug 8 08:10:29.837229228 (22h30m51.58128609s) [upload=23299]: Got next segment. Inline: true Aug 8 08:10:29.837234342 (22h30m51.581291201s) [upload=23299]: Waiting for error group managing segments... Aug 8 08:10:29.837275114 (22h30m51.581331962s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:29.837279640 (22h30m51.5813365s) [upload=23299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:29.837282167 (22h30m51.581339027s) [upload=23299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:30.221609733 (22h30m51.965666588s) [upload=23299]: Done uploading segments... Aug 8 08:10:30.221635147 (22h30m51.965691999s) [upload=23299]: Upload finished. err: <nil> Aug 8 08:10:46.554914705 (22h31m8.298971575s) [upload=23306]: Starting upload Aug 8 08:10:46.555035271 (22h31m8.299092127s) [upload=23306]: Done starting upload Aug 8 08:10:46.555155837 (22h31m8.299212701s) [upload=23306]: Uploading segments... Aug 8 08:10:46.555285312 (22h31m8.299342188s) [upload=23306]: Got next segment. Inline: true Aug 8 08:10:46.555294037 (22h31m8.29935091s) [upload=23306]: Waiting for error group managing segments... Aug 8 08:10:46.555373576 (22h31m8.299430446s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:10:46.555380833 (22h31m8.299437703s) [upload=23306]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:10:46.555388232 (22h31m8.299445104s) [upload=23306]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:10:46.709433834 (22h31m8.453490683s) [upload=23306]: Done uploading segments... Aug 8 08:10:46.709487101 (22h31m8.453543949s) [upload=23306]: Upload finished. err: <nil> Aug 8 08:11:10.552157402 (22h31m32.296214269s) [upload=23313]: Starting upload Aug 8 08:11:10.552442618 (22h31m32.296499493s) [upload=23313]: Done starting upload Aug 8 08:11:10.552586700 (22h31m32.296643566s) [upload=23313]: Uploading segments... Aug 8 08:11:10.552692759 (22h31m32.296749636s) [upload=23313]: Got next segment. Inline: true Aug 8 08:11:10.552701484 (22h31m32.296758367s) [upload=23313]: Waiting for error group managing segments... Aug 8 08:11:10.552814800 (22h31m32.296871662s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:10.552824977 (22h31m32.296881843s) [upload=23313]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:10.552829160 (22h31m32.296886025s) [upload=23313]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:10.809107506 (22h31m32.553164367s) [upload=23313]: Done uploading segments... Aug 8 08:11:10.809128806 (22h31m32.553185656s) [upload=23313]: Upload finished. err: <nil> Aug 8 08:11:51.665066000 (22h32m13.409122864s) [upload=23327]: Starting upload Aug 8 08:11:51.665134679 (22h32m13.409191538s) [upload=23327]: Done starting upload Aug 8 08:11:51.665212446 (22h32m13.409269303s) [upload=23327]: Uploading segments... Aug 8 08:11:51.665271977 (22h32m13.409328847s) [upload=23327]: Got next segment. Inline: true Aug 8 08:11:51.665280321 (22h32m13.40933719s) [upload=23327]: Waiting for error group managing segments... Aug 8 08:11:51.665336951 (22h32m13.409393801s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:11:51.665342944 (22h32m13.409399805s) [upload=23327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:11:51.665346833 (22h32m13.409403695s) [upload=23327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:11:51.825733106 (22h32m13.56978998s) [upload=23327]: Done uploading segments... Aug 8 08:11:51.825774704 (22h32m13.569831581s) [upload=23327]: Upload finished. err: <nil> Aug 8 08:12:36.713629283 (22h32m58.457686133s) [upload=23340]: Starting upload Aug 8 08:12:36.713677793 (22h32m58.45773466s) [upload=23340]: Done starting upload Aug 8 08:12:36.713768858 (22h32m58.457825706s) [upload=23340]: Uploading segments... Aug 8 08:12:36.713810753 (22h32m58.457867622s) [upload=23340]: Got next segment. Inline: true Aug 8 08:12:36.713816380 (22h32m58.457873243s) [upload=23340]: Waiting for error group managing segments... Aug 8 08:12:36.713871367 (22h32m58.457928216s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:12:36.713876878 (22h32m58.457933741s) [upload=23340]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:12:36.713880179 (22h32m58.45793704s) [upload=23340]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:12:36.860375743 (22h32m58.604432607s) [upload=23340]: Done uploading segments... Aug 8 08:12:36.860409095 (22h32m58.60446596s) [upload=23340]: Upload finished. err: <nil> Aug 8 08:13:34.010890464 (22h33m55.754947314s) [upload=23357]: Starting upload Aug 8 08:13:34.010944798 (22h33m55.755001648s) [upload=23357]: Done starting upload Aug 8 08:13:34.011030226 (22h33m55.755087078s) [upload=23357]: Uploading segments... Aug 8 08:13:34.011071681 (22h33m55.755128547s) [upload=23357]: Got next segment. Inline: true Aug 8 08:13:34.011076449 (22h33m55.755133302s) [upload=23357]: Waiting for error group managing segments... Aug 8 08:13:34.011120225 (22h33m55.755177076s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:13:34.011126537 (22h33m55.755183388s) [upload=23357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:13:34.011132794 (22h33m55.755189644s) [upload=23357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:13:34.169754204 (22h33m55.913811067s) [upload=23357]: Done uploading segments... Aug 8 08:13:34.169777081 (22h33m55.913833941s) [upload=23357]: Upload finished. err: <nil> Aug 8 08:14:05.431776093 (22h34m27.175832955s) [upload=23367]: Starting upload Aug 8 08:14:05.431855898 (22h34m27.175912767s) [upload=23367]: Done starting upload Aug 8 08:14:05.431939997 (22h34m27.175996849s) [upload=23367]: Uploading segments... Aug 8 08:14:05.431995611 (22h34m27.17605248s) [upload=23367]: Got next segment. Inline: true Aug 8 08:14:05.432001071 (22h34m27.176057931s) [upload=23367]: Waiting for error group managing segments... Aug 8 08:14:05.432063159 (22h34m27.17612001s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:14:05.432070467 (22h34m27.176127317s) [upload=23367]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:14:05.432074258 (22h34m27.17613111s) [upload=23367]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:14:05.625809853 (22h34m27.369866707s) [upload=23367]: Done uploading segments... Aug 8 08:14:05.625830031 (22h34m27.369886882s) [upload=23367]: Upload finished. err: <nil> Aug 8 08:15:07.534950807 (22h35m29.279007669s) [upload=23383]: Starting upload Aug 8 08:15:07.535020031 (22h35m29.279076889s) [upload=23383]: Done starting upload Aug 8 08:15:07.535117916 (22h35m29.279174769s) [upload=23383]: Uploading segments... Aug 8 08:15:07.535195212 (22h35m29.279252078s) [upload=23383]: Got next segment. Inline: true Aug 8 08:15:07.535200934 (22h35m29.279257806s) [upload=23383]: Waiting for error group managing segments... Aug 8 08:15:07.535540314 (22h35m29.279597177s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:07.535549666 (22h35m29.27960653s) [upload=23383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:07.535555009 (22h35m29.279611878s) [upload=23383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:07.697698439 (22h35m29.441755304s) [upload=23383]: Done uploading segments... Aug 8 08:15:07.697725357 (22h35m29.441782221s) [upload=23383]: Upload finished. err: <nil> Aug 8 08:15:42.083496980 (22h36m3.827553843s) [upload=23393]: Starting upload Aug 8 08:15:42.083555873 (22h36m3.827612724s) [upload=23393]: Done starting upload Aug 8 08:15:42.083641487 (22h36m3.827698346s) [upload=23393]: Uploading segments... Aug 8 08:15:42.083710642 (22h36m3.827767511s) [upload=23393]: Got next segment. Inline: true Aug 8 08:15:42.083717471 (22h36m3.827774331s) [upload=23393]: Waiting for error group managing segments... Aug 8 08:15:42.083765650 (22h36m3.8278225s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:42.083773936 (22h36m3.827830796s) [upload=23393]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:42.083777986 (22h36m3.827834845s) [upload=23393]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:42.228592880 (22h36m3.972649744s) [upload=23393]: Done uploading segments... Aug 8 08:15:42.228668918 (22h36m3.972725769s) [upload=23393]: Upload finished. err: <nil> Aug 8 08:15:58.128103092 (22h36m19.872159942s) [upload=23398]: Starting upload Aug 8 08:15:58.128175442 (22h36m19.872232303s) [upload=23398]: Done starting upload Aug 8 08:15:58.128434515 (22h36m19.872491371s) [upload=23398]: Uploading segments... Aug 8 08:15:58.128544452 (22h36m19.872601306s) [upload=23398]: Got next segment. Inline: true Aug 8 08:15:58.128552404 (22h36m19.872609253s) [upload=23398]: Waiting for error group managing segments... Aug 8 08:15:58.128628635 (22h36m19.872685501s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:58.128635719 (22h36m19.872692583s) [upload=23398]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 08:15:58.128640733 (22h36m19.872697601s) [upload=23398]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:58.217762569 (22h36m19.96181943s) [upload=23398]: Done uploading segments... Aug 8 08:15:58.217781822 (22h36m19.961838682s) [upload=23398]: Upload finished. err: metaclient: Too Many Requests Duration: 364.91363ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 826.766787ms FAIL (2025-08-08 08:15:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 826.799163ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.............X......................................X] duration: 2.249007511s FAIL (2025-08-08 08:15:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 63c5ed61906e11936b68f2ef52fda9f63fb635ba87d64be4f33bf3a1c4bc8e75 != before 1622e88812ebafab9753f9096dd3c401166e31560ad135f8f9a49413a63f7e27 ======LOGS====== 8s) [upload=23386]: Uploading segments... Aug 8 08:15:27.387895706 (22h35m49.131952567s) [upload=23386]: Got next segment. Inline: false Aug 8 08:15:27.387970058 (22h35m49.132026908s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 08:15:27.387976701 (22h35m49.132033565s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 08:15:27.586328226 (22h35m49.330385077s) [seg_pos={0 0}, upload=23386]: Begin upload segment... Aug 8 08:15:27.586390235 (22h35m49.330447099s) [seg_pos={0 0}, upload=23386]: Done begin upload segment. Aug 8 08:15:27.586434842 (22h35m49.330491713s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586451078 (22h35m49.330507943s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.586872054 (22h35m49.330928917s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587210058 (22h35m49.331266918s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587532196 (22h35m49.331589056s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.587844962 (22h35m49.331901822s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588189974 (22h35m49.332246841s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.588643723 (22h35m49.33270059s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589042544 (22h35m49.333099405s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589382110 (22h35m49.333438973s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589694361 (22h35m49.33375123s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.589787307 (22h35m49.33384417s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590277824 (22h35m49.334334687s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590630718 (22h35m49.334687579s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.590943350 (22h35m49.335000216s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591087045 (22h35m49.335143916s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591500868 (22h35m49.335557727s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:27.591842841 (22h35m49.335899701s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Uploading piece... Aug 8 08:15:28.158331873 (22h35m49.902388733s) [upload=23386]: Next returned nil segment Aug 8 08:15:28.158353292 (22h35m49.902410143s) [upload=23386]: Waiting for error group managing segments... Aug 8 08:15:28.322414292 (22h35m50.066471145s) [noise=true , address=45.91.116.8:4059 , piece_id=NHQAF7GJ4NRQUCS53RZN5DCV366HJSFCOMCGVU7ME5ICRR64O7WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.323117212 (22h35m50.067174063s) [noise=true , address=45.91.116.14:4204 , piece_id=DALND2AOMMJMY5GDDRNLTXK3PX2JLFUMXZ5Y4HUJGQIZ5SIMXOFA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328133673 (22h35m50.072190523s) [noise=true , address=104.36.82.62:4416 , piece_id=ZKCNR4NAZGHJ52SYI6Q6ZPW5QNCD4GNY25QKUQXTYMMI2CCV6HLA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.328661020 (22h35m50.07271788s) [noise=true , address=45.91.116.13:4168 , piece_id=UACG2O5A4OU6I2ERIOPNDWCSVKTPRVXZMGMJHFBGQTDMIJAHLBGQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340035703 (22h35m50.084092555s) [noise=true , address=104.36.82.45:4926 , piece_id=Y2XCSLAA4TCZCE2YJM5NT5ZY4DODJ6MQQAGPFFGK7I323WH66QVA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.340562308 (22h35m50.084619159s) [noise=true , address=45.91.116.7:4034 , piece_id=5ABEJBJTIWU77AUFGRVUPN5FIHE7LAU4P6PRTR7EEUTW7JXSN6TA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.341044839 (22h35m50.085101689s) [noise=true , address=104.36.82.61:4408 , piece_id=XGZ233VZ4ZPWDQKIOEXSXH3WO53WQD6KUPOSI7CBWJABEBJPG4AA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.342424182 (22h35m50.086481029s) [noise=true , address=104.36.82.14:4253 , piece_id=M32GZERPRPZIEKQGMUOA2FQSAMIZBYLXULL3KNBN7XNFR2KGG6GQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.353086606 (22h35m50.09714346s) [noise=true , address=104.36.82.46:4486 , piece_id=P6XNH6SPESJH5XJCEYQCACEXU5QRFMAUTGPVWO4RBSUOWYX32J6Q, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354242357 (22h35m50.098299209s) [noise=true , address=104.36.82.23:4469 , piece_id=OA7653VXCPN3KBZWU644UJPISLYZ6OS764PDWPLMVBLVWNAYUVVQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.354709810 (22h35m50.098766673s) [noise=true , address=104.36.82.60:4371 , piece_id=UGOCJU4NOWGW73AHXPBXHYFJLWGEVCT7MHCBHYIRITJQDPKHMBOQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.359072209 (22h35m50.103129061s) [noise=true , address=104.36.82.37:4661 , piece_id=JPSASPR3BIZ7QQW7KHBBTLH3SLIYM2ARLADOYTT2DI637ILDU5WA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.368405498 (22h35m50.112462344s) [noise=true , address=104.36.82.59:4303 , piece_id=ACINHYN7D6XRV5NTBN6CE4536ZUPSMWGZGZZJVUJBCIHDPQ7KNYA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369039702 (22h35m50.113096548s) [noise=true , address=104.36.82.16:4315 , piece_id=GYYIGVQNWW2OWKVXFIYWQI4ZWEKAU7TNCGRA55FGPKMJCKCVZBGA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: <nil> Aug 8 08:15:28.369050850 (22h35m50.113107696s) [seg_pos={0 0}, upload=23386]: Segment reached optimal threshold of 14 pieces. Aug 8 08:15:28.369182993 (22h35m50.113239839s) [noise=true , address=104.36.82.35:4599 , piece_id=PC66PXZI4Q7UH2QZKC5BXR5GU5CK77JN5IFHUUZUKKLRURQB6ACA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxKQjpzyhZsRnkffX1fwCXcTYiwHPwuNg4HWtpdzRnKQCtp6s): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369466440 (22h35m50.113523287s) [noise=true , address=104.36.82.4:4836 , piece_id=VO5TFY45CY2SXRLKETIRDWQ5P4GNNXEJRYESVABHJ2AVHUOWOMDQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fjbyyAnz2pYU8drcBLyd1VzHgsNSWAxdWXovYJWzTcSdANzNe): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369530522 (22h35m50.113587368s) [noise=true , address=104.36.82.44:4876 , piece_id=ALYV7HCNJG4TFI5D4VOX3OZTNXSWBQIRMVU4EVKVIDGMMQLWOIUQ, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RZEXg8h3qbrw3mJadmpudtBsVadHMb4knwtueL7GhdHLkESYC): protocol: expected piece hash; context canceled; EOF Aug 8 08:15:28.369638823 (22h35m50.11369567s) [noise=true , address=64.49.13.169:4710 , piece_id=PPWQZEVYYT3N6CUYZ4CA3JK4VLHANSEHOBVMD2C7YZWUK2F54LRA, seg_pos={0 0}, upload=23386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36670->64.49.13.169:4710: use of closed network connection Aug 8 08:15:28.369651872 (22h35m50.113708719s) [seg_pos={0 0}, upload=23386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 08:15:28.369716021 (22h35m50.113772882s) [upload=23386]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 08:15:28.369722390 (22h35m50.11377925s) [upload=23386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 08:15:28.517255405 (22h35m50.261312275s) [upload=23386]: Done uploading segments... Aug 8 08:15:28.517280948 (22h35m50.261337812s) [upload=23386]: Upload finished. err: <nil> Duration: 2.249387939s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 858.792977ms FAIL (2025-08-08 08:15:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 858.82918ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.............X......................................] duration: 2.51282847s FAIL (2025-08-08 08:14:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.512858664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 889.680116ms FAIL (2025-08-08 08:14:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 889.716258ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 852.77334ms FAIL (2025-08-08 08:13:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 852.810582ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.............X.....................................] duration: 2.377707448s FAIL (2025-08-08 08:13:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.377758664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 833.757703ms FAIL (2025-08-08 08:12:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 833.791782ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.............X....................................] duration: 2.468974715s FAIL (2025-08-08 08:12:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.469006075s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 849.218601ms FAIL (2025-08-08 08:11:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 849.347317ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.............X...................................] duration: 2.589935931s FAIL (2025-08-08 08:11:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.590044902s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 962.790096ms FAIL (2025-08-08 08:11:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 962.844533ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X.............X..................................] duration: 2.332342165s FAIL (2025-08-08 08:10:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.332373578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 839.018594ms FAIL (2025-08-08 08:10:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 839.048723ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X............X..............................................] duration: 1.2693538s FAIL (2025-08-08 08:10:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 1.269621472s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X.............X.................................] duration: 2.46555293s FAIL (2025-08-08 08:09:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.465578407s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X............X.............................................] duration: 837.410661ms FAIL (2025-08-08 08:09:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 837.443457ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X.............X................................] duration: 2.341205744s FAIL (2025-08-08 08:09:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.341234799s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X............X............................................] duration: 822.036157ms FAIL (2025-08-08 08:08:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 822.063119ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X.............X...............................] duration: 2.322909877s FAIL (2025-08-08 08:08:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.323003326s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X............X...........................................] duration: 942.952699ms FAIL (2025-08-08 08:07:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 943.039148ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X.............X..............................] duration: 2.343468994s FAIL (2025-08-08 08:07:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.343520403s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X.............X.............................] duration: 2.44164409s FAIL (2025-08-08 08:06:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.441680277s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X............X..........................................] duration: 835.973406ms FAIL (2025-08-08 08:06:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 836.016095ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X............X.........................................] duration: 835.29072ms FAIL (2025-08-08 08:06:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 835.334195ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X.............X............................] duration: 2.473544362s FAIL (2025-08-08 08:06:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.473575427s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X.............X...........................] duration: 2.240155486s FAIL (2025-08-08 08:05:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.240186556s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X.............X..........................] duration: 2.256686559s FAIL (2025-08-08 08:05:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.256718913s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X............X........................................] duration: 872.591919ms FAIL (2025-08-08 08:05:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 872.623763ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X............X.......................................] duration: 870.777207ms FAIL (2025-08-08 08:05:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 870.815839ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration: 2.328942738s FAIL (2025-08-08 08:04:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.328976399s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X............X......................................] duration: 817.101624ms FAIL (2025-08-08 08:04:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 817.136705ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration: 2.599437984s FAIL (2025-08-08 08:03:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ug 8 07:44:54.751590911 (22h5m16.495647762s) [upload=22848]: Uploading segments... Aug 8 07:44:54.751658720 (22h5m16.495715589s) [upload=22848]: Got next segment. Inline: false Aug 8 07:44:54.751719012 (22h5m16.495775863s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:44:54.751725665 (22h5m16.495782529s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:44:54.985618599 (22h5m16.729675468s) [seg_pos={0 0}, upload=22848]: Begin upload segment... Aug 8 07:44:54.985698125 (22h5m16.729754995s) [seg_pos={0 0}, upload=22848]: Done begin upload segment. Aug 8 07:44:54.985738466 (22h5m16.729795333s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.985768041 (22h5m16.729824912s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986139385 (22h5m16.730196246s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986349017 (22h5m16.730405887s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986400827 (22h5m16.730457694s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986647949 (22h5m16.730704815s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.986880249 (22h5m16.730937117s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987004019 (22h5m16.731060887s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987368858 (22h5m16.731425724s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987438462 (22h5m16.731495333s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987669884 (22h5m16.731726749s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987936552 (22h5m16.731993423s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.987961194 (22h5m16.732018059s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988406437 (22h5m16.732463286s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.988592123 (22h5m16.732648995s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990368267 (22h5m16.734425139s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.990932598 (22h5m16.734989468s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:54.991923285 (22h5m16.735980156s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Uploading piece... Aug 8 07:44:55.567559969 (22h5m17.31161683s) [upload=22848]: Next returned nil segment Aug 8 07:44:55.567577974 (22h5m17.311634825s) [upload=22848]: Waiting for error group managing segments... Aug 8 07:44:55.718304642 (22h5m17.462361503s) [noise=true , address=104.36.82.15:4285 , piece_id=K4RVD4KMLZABMKLBX7VGVYKFF7H7QYQGB32TEVUK5S5ZMGQ6EF2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.720555765 (22h5m17.464612616s) [noise=true , address=104.36.82.35:4593 , piece_id=GMDGSEHZAQ4SFIEUDGV625YHF6N5PVMY7YG2VKSQV7EDAHLBWC6A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.721637183 (22h5m17.465694037s) [noise=true , address=104.36.82.37:4674 , piece_id=DMOBALZKGFRLPQQ5BYFXK3FOIQZ2CIR6DSRSDJZQ5A2HVPVNFULA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.728984698 (22h5m17.473041548s) [noise=true , address=104.36.82.8:4995 , piece_id=FGG74L4FLHGDO4PRSPAFRENEDXGLJQP3BGOD2CRF6YE4P4RFTSGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.729862377 (22h5m17.473919227s) [noise=true , address=104.36.82.16:4322 , piece_id=ATUMNNLDDOPPV7OZPG6BVQSSU25TEKIIN6KUPOQ6GGEWD6NJN56Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733022040 (22h5m17.477078908s) [noise=true , address=104.36.82.45:4910 , piece_id=RQXGCV47TUDANVZNWD4CQ25VXVBPUDWQIKQSYMWP5LW2M32LL3NA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.733823140 (22h5m17.477880003s) [noise=true , address=104.36.82.61:4388 , piece_id=JO6CMEOZ2ZA7NH77KQ6FPFZU5SFPGQ6W5DYIZ4K4N5W3ZETR5WIQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.734631778 (22h5m17.478688638s) [noise=true , address=104.36.82.58:4265 , piece_id=GIIVYJXOM54KDZ3NJPYRFKO7EUXQMXJUZ3PUSF2BE7UAQP2YNNPQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735591796 (22h5m17.479648651s) [noise=true , address=104.36.82.60:4356 , piece_id=DIGVTKDZI55YXW2JKQFTT3P4OPCC36TPJBWW45U5PYKADXWTYYZQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.735807359 (22h5m17.479864207s) [noise=true , address=104.36.82.23:4476 , piece_id=7WDW6IIU5SMP2Y3BDPPSBARIYTBDNU5SJDWLBTUPFIZIMKJLB5NQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.739664863 (22h5m17.483721712s) [noise=true , address=104.36.82.2:4761 , piece_id=GIAMC7HARWRYNDO5FEP5BBQVU6UUDHQICRFNTLILYUSLKBJ6ZAGA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.746813653 (22h5m17.490870502s) [noise=true , address=104.36.82.5:4847 , piece_id=EOMNU3FQE6WNE5GODL27BO7PEWLWOC2RTWNCD74N724TWUSPIBYA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.747914302 (22h5m17.491971154s) [noise=true , address=104.36.82.38:4707 , piece_id=JJMCUAKFQDY6CHQZLBLPWZ6HYHV3LWQIKANSQ2MOAKZKY4U4GMJQ, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754657816 (22h5m17.498714662s) [noise=true , address=104.36.82.44:4880 , piece_id=JH22OD6K52QHLI52UBFTGWOPOSNOZ3KCULQFDMVSRL2M7CMM4S2A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: <nil> Aug 8 07:44:55.754719453 (22h5m17.498776314s) [seg_pos={0 0}, upload=22848]: Segment reached optimal threshold of 14 pieces. Aug 8 07:44:55.755035717 (22h5m17.499092565s) [noise=true , address=104.36.82.62:4425 , piece_id=6QJ3Y6A6MDWS4XGF52YLSPHSKNA4TFMSUH5H4UEHGXXK27GVNARA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12buSFYfQN8eDP36VhF9uFUgCsZFke9Ggke3r78pcNMEtCW6CGJ): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755184813 (22h5m17.499241678s) [noise=true , address=104.36.82.47:4545 , piece_id=LSVZUI72N6FZR4HBXGW7FMSXMTKDPTPHE2UELPF3TWUGGXBOIX2Q, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12euvmhGegnPYufoKKQ1on9FTv2AhuicSVYuWyXtDiY9BLdDMYE): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755290567 (22h5m17.49934742s) [noise=true , address=64.49.13.155:4915 , piece_id=6VJY6DC4YYJXUIYIM73E2UBQTVORLXDA4CKAVFWKIFW32ZU2362A, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42172->64.49.13.155:4915: use of closed network connection Aug 8 07:44:55.755312610 (22h5m17.499369473s) [noise=true , address=104.36.82.14:4254 , piece_id=H442A6FCOEBKVPITX6NYCNZRWV46SKNQPEJPAI2PEHBN2VBX76WA, seg_pos={0 0}, upload=22848]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bH5wgoULxFcdaLErG9JUnkbSfkLxv3zYu7VYhpAkRfQV2YJ91): protocol: expected piece hash; context canceled; EOF Aug 8 07:44:55.755331293 (22h5m17.499388162s) [seg_pos={0 0}, upload=22848]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 07:44:55.755467413 (22h5m17.499524282s) [upload=22848]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:44:55.755475836 (22h5m17.499532705s) [upload=22848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:44:55.906955784 (22h5m17.651012652s) [upload=22848]: Done uploading segments... Aug 8 07:44:55.906985513 (22h5m17.651042395s) [upload=22848]: Upload finished. err: <nil> Duration: 2.599538945s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X............X.....................................] duration: 1.063491033s FAIL (2025-08-08 08:03:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ding segments... Aug 8 07:25:20.581613930 (21h45m42.325670782s) [upload=22497]: Upload finished. err: <nil> Aug 8 07:26:22.798833321 (21h46m44.542890199s) [upload=22516]: Starting upload Aug 8 07:26:22.798959834 (21h46m44.543016706s) [upload=22516]: Done starting upload Aug 8 07:26:22.799045014 (21h46m44.543101876s) [upload=22516]: Uploading segments... Aug 8 07:26:22.799108699 (21h46m44.543165571s) [upload=22516]: Got next segment. Inline: true Aug 8 07:26:22.799115475 (21h46m44.543172339s) [upload=22516]: Waiting for error group managing segments... Aug 8 07:26:22.799170612 (21h46m44.543227488s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:22.799177430 (21h46m44.543234293s) [upload=22516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:22.799181354 (21h46m44.543238221s) [upload=22516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:22.961397344 (21h46m44.705454197s) [upload=22516]: Done uploading segments... Aug 8 07:26:22.961419309 (21h46m44.705476159s) [upload=22516]: Upload finished. err: <nil> Aug 8 07:26:50.928613836 (21h47m12.672670713s) [upload=22525]: Starting upload Aug 8 07:26:50.928703315 (21h47m12.672760204s) [upload=22525]: Done starting upload Aug 8 07:26:50.928805118 (21h47m12.672861964s) [upload=22525]: Uploading segments... Aug 8 07:26:50.928865450 (21h47m12.67292232s) [upload=22525]: Got next segment. Inline: true Aug 8 07:26:50.928872329 (21h47m12.672929199s) [upload=22525]: Waiting for error group managing segments... Aug 8 07:26:50.928921758 (21h47m12.672978627s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:50.928927904 (21h47m12.672984788s) [upload=22525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:50.928932261 (21h47m12.672989131s) [upload=22525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:51.084398897 (21h47m12.828455757s) [upload=22525]: Done uploading segments... Aug 8 07:26:51.084420061 (21h47m12.828476913s) [upload=22525]: Upload finished. err: <nil> Aug 8 07:27:09.408182227 (21h47m31.152239101s) [upload=22533]: Starting upload Aug 8 07:27:09.408257779 (21h47m31.152314633s) [upload=22533]: Done starting upload Aug 8 07:27:09.408345392 (21h47m31.152402244s) [upload=22533]: Uploading segments... Aug 8 07:27:09.408408146 (21h47m31.152465018s) [upload=22533]: Got next segment. Inline: true Aug 8 07:27:09.408414544 (21h47m31.15247141s) [upload=22533]: Waiting for error group managing segments... Aug 8 07:27:09.408483900 (21h47m31.152540747s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:09.408489678 (21h47m31.152546546s) [upload=22533]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:09.408493868 (21h47m31.152550731s) [upload=22533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:09.543356884 (21h47m31.287413756s) [upload=22533]: Done uploading segments... Aug 8 07:27:09.543381978 (21h47m31.287438832s) [upload=22533]: Upload finished. err: <nil> Aug 8 07:28:17.295000698 (21h48m39.039057559s) [upload=22556]: Starting upload Aug 8 07:28:17.295059163 (21h48m39.039116023s) [upload=22556]: Done starting upload Aug 8 07:28:17.295139482 (21h48m39.039196332s) [upload=22556]: Uploading segments... Aug 8 07:28:17.295201120 (21h48m39.039257989s) [upload=22556]: Got next segment. Inline: true Aug 8 07:28:17.295206634 (21h48m39.039263486s) [upload=22556]: Waiting for error group managing segments... Aug 8 07:28:17.295266742 (21h48m39.039323592s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:17.295272222 (21h48m39.039329074s) [upload=22556]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:17.295276285 (21h48m39.039333139s) [upload=22556]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:17.446035359 (21h48m39.19009221s) [upload=22556]: Done uploading segments... Aug 8 07:28:17.446058218 (21h48m39.190115067s) [upload=22556]: Upload finished. err: <nil> Aug 8 07:28:57.180517377 (21h49m18.924574247s) [upload=22566]: Starting upload Aug 8 07:28:57.180605018 (21h49m18.924661869s) [upload=22566]: Done starting upload Aug 8 07:28:57.180691949 (21h49m18.924748809s) [upload=22566]: Uploading segments... Aug 8 07:28:57.180753902 (21h49m18.924810771s) [upload=22566]: Got next segment. Inline: true Aug 8 07:28:57.180759840 (21h49m18.924816701s) [upload=22566]: Waiting for error group managing segments... Aug 8 07:28:57.180817468 (21h49m18.924874317s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:57.180822843 (21h49m18.924879703s) [upload=22566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:57.180826760 (21h49m18.924883619s) [upload=22566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:57.331213663 (21h49m19.075270528s) [upload=22566]: Done uploading segments... Aug 8 07:28:57.331239443 (21h49m19.075296292s) [upload=22566]: Upload finished. err: <nil> Aug 8 07:30:09.491813610 (21h50m31.23587046s) [upload=22586]: Starting upload Aug 8 07:30:09.492114051 (21h50m31.236170913s) [upload=22586]: Done starting upload Aug 8 07:30:09.492266021 (21h50m31.236322867s) [upload=22586]: Uploading segments... Aug 8 07:30:09.492339322 (21h50m31.236396195s) [upload=22586]: Got next segment. Inline: true Aug 8 07:30:09.492346839 (21h50m31.236403706s) [upload=22586]: Waiting for error group managing segments... Aug 8 07:30:09.492427291 (21h50m31.236484155s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:09.492450078 (21h50m31.23650694s) [upload=22586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:09.492455851 (21h50m31.236512714s) [upload=22586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:09.635150985 (21h50m31.379207843s) [upload=22586]: Done uploading segments... Aug 8 07:30:09.635174519 (21h50m31.379231368s) [upload=22586]: Upload finished. err: <nil> Aug 8 07:31:17.751522602 (21h51m39.495579451s) [upload=22607]: Starting upload Aug 8 07:31:17.751593045 (21h51m39.495649908s) [upload=22607]: Done starting upload Aug 8 07:31:17.751701185 (21h51m39.495758048s) [upload=22607]: Uploading segments... Aug 8 07:31:17.751820279 (21h51m39.495877142s) [upload=22607]: Got next segment. Inline: true Aug 8 07:31:17.751827929 (21h51m39.495884789s) [upload=22607]: Waiting for error group managing segments... Aug 8 07:31:17.751998747 (21h51m39.496055611s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:31:17.752007779 (21h51m39.496064646s) [upload=22607]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:31:17.752011452 (21h51m39.496068313s) [upload=22607]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:31:17.906180264 (21h51m39.650237131s) [upload=22607]: Done uploading segments... Aug 8 07:31:17.906199696 (21h51m39.650256564s) [upload=22607]: Upload finished. err: <nil> Aug 8 07:32:28.897078558 (21h52m50.641135408s) [upload=22632]: Starting upload Aug 8 07:32:28.897163805 (21h52m50.641220669s) [upload=22632]: Done starting upload Aug 8 07:32:28.897274890 (21h52m50.641331739s) [upload=22632]: Uploading segments... Aug 8 07:32:28.897376764 (21h52m50.641433627s) [upload=22632]: Got next segment. Inline: true Aug 8 07:32:28.897383086 (21h52m50.64143995s) [upload=22632]: Waiting for error group managing segments... Aug 8 07:32:28.897447881 (21h52m50.641504742s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:32:28.897453669 (21h52m50.64151053s) [upload=22632]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:32:28.897457080 (21h52m50.641513944s) [upload=22632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:32:29.192961527 (21h52m50.937018393s) [upload=22632]: Done uploading segments... Aug 8 07:32:29.192988866 (21h52m50.937045725s) [upload=22632]: Upload finished. err: <nil> Aug 8 07:33:20.217650534 (21h53m41.961707398s) [upload=22647]: Starting upload Aug 8 07:33:20.217746265 (21h53m41.961803125s) [upload=22647]: Done starting upload Aug 8 07:33:20.217900719 (21h53m41.961957576s) [upload=22647]: Uploading segments... Aug 8 07:33:20.218013158 (21h53m41.962070019s) [upload=22647]: Got next segment. Inline: true Aug 8 07:33:20.218019528 (21h53m41.962076392s) [upload=22647]: Waiting for error group managing segments... Aug 8 07:33:20.218069827 (21h53m41.962126677s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:33:20.218076414 (21h53m41.962133265s) [upload=22647]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:33:20.218092208 (21h53m41.962149069s) [upload=22647]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:33:20.592027701 (21h53m42.33608458s) [upload=22647]: Done uploading segments... Aug 8 07:33:20.592053405 (21h53m42.336110268s) [upload=22647]: Upload finished. err: <nil> Aug 8 07:34:21.508355042 (21h54m43.252411893s) [upload=22665]: Starting upload Aug 8 07:34:21.508421170 (21h54m43.252478031s) [upload=22665]: Done starting upload Aug 8 07:34:21.508516280 (21h54m43.25257313s) [upload=22665]: Uploading segments... Aug 8 07:34:21.508600529 (21h54m43.252657391s) [upload=22665]: Got next segment. Inline: true Aug 8 07:34:21.508617447 (21h54m43.252674308s) [upload=22665]: Waiting for error group managing segments... Aug 8 07:34:21.508673261 (21h54m43.252730108s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:34:21.508697276 (21h54m43.252754144s) [upload=22665]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:34:21.508702512 (21h54m43.252759364s) [upload=22665]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:34:21.650219045 (21h54m43.394275901s) [upload=22665]: Done uploading segments... Aug 8 07:34:21.650244585 (21h54m43.394301453s) [upload=22665]: Upload finished. err: <nil> Duration: 1.063515631s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)