Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X.....X.........................X........X....XX...........] duration: 2.35706102s FAIL (2025-08-13 03:21:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.357093833s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X..X...] duration: 868.951232ms FAIL (2025-08-13 03:20:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c124cad1373443148a93c4b560eeb83af4cfec61df5b407dae11bfb2b598bb47 != before 8ef288d0a9b274a3b23a83edbc7582b37ee851911a59b44b8c71af5262134b04 ======LOGS====== Aug 13 03:18:59.707249605 (105h53m21.666346851s) [upload=110337]: Starting upload Aug 13 03:18:59.707337651 (105h53m21.666434899s) [upload=110337]: Done starting upload Aug 13 03:18:59.707416879 (105h53m21.666514173s) [upload=110337]: Uploading segments... Aug 13 03:18:59.707484976 (105h53m21.66658223s) [upload=110337]: Got next segment. Inline: true Aug 13 03:18:59.707490998 (105h53m21.666588243s) [upload=110337]: Waiting for error group managing segments... Aug 13 03:18:59.707538357 (105h53m21.666635603s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:18:59.707543265 (105h53m21.66664051s) [upload=110337]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:18:59.707546744 (105h53m21.666643989s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:18:59.855858884 (105h53m21.814956123s) [upload=110337]: Done uploading segments... Aug 13 03:18:59.855879502 (105h53m21.814976736s) [upload=110337]: Upload finished. err: <nil> Duration:* 868.982977ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.352033047s FAIL (2025-08-13 03:20:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.352069668s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X.....X.........................X........X....XX..........] duration: 2.383653261s FAIL (2025-08-13 03:20:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.383681333s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.058219781s FAIL (2025-08-13 03:20:20 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.058262663s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X..X..] duration: 1.062093235s FAIL (2025-08-13 03:20:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c124cad1373443148a93c4b560eeb83af4cfec61df5b407dae11bfb2b598bb47 != before 8ef288d0a9b274a3b23a83edbc7582b37ee851911a59b44b8c71af5262134b04 ======LOGS====== Aug 13 03:18:59.707249605 (105h53m21.666346851s) [upload=110337]: Starting upload Aug 13 03:18:59.707337651 (105h53m21.666434899s) [upload=110337]: Done starting upload Aug 13 03:18:59.707416879 (105h53m21.666514173s) [upload=110337]: Uploading segments... Aug 13 03:18:59.707484976 (105h53m21.66658223s) [upload=110337]: Got next segment. Inline: true Aug 13 03:18:59.707490998 (105h53m21.666588243s) [upload=110337]: Waiting for error group managing segments... Aug 13 03:18:59.707538357 (105h53m21.666635603s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:18:59.707543265 (105h53m21.66664051s) [upload=110337]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:18:59.707546744 (105h53m21.666643989s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:18:59.855858884 (105h53m21.814956123s) [upload=110337]: Done uploading segments... Aug 13 03:18:59.855879502 (105h53m21.814976736s) [upload=110337]: Upload finished. err: <nil> Duration:* 1.062147685s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.198043729s FAIL (2025-08-13 03:19:59 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.19807342s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X.....X.........................X........X....XX.........] duration: 2.40110742s FAIL (2025-08-13 03:19:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.401137898s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X..X.] duration: 833.065384ms FAIL (2025-08-13 03:19:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c124cad1373443148a93c4b560eeb83af4cfec61df5b407dae11bfb2b598bb47 != before 8ef288d0a9b274a3b23a83edbc7582b37ee851911a59b44b8c71af5262134b04 ======LOGS====== Aug 13 03:18:59.707249605 (105h53m21.666346851s) [upload=110337]: Starting upload Aug 13 03:18:59.707337651 (105h53m21.666434899s) [upload=110337]: Done starting upload Aug 13 03:18:59.707416879 (105h53m21.666514173s) [upload=110337]: Uploading segments... Aug 13 03:18:59.707484976 (105h53m21.66658223s) [upload=110337]: Got next segment. Inline: true Aug 13 03:18:59.707490998 (105h53m21.666588243s) [upload=110337]: Waiting for error group managing segments... Aug 13 03:18:59.707538357 (105h53m21.666635603s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:18:59.707543265 (105h53m21.66664051s) [upload=110337]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:18:59.707546744 (105h53m21.666643989s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:18:59.855858884 (105h53m21.814956123s) [upload=110337]: Done uploading segments... Aug 13 03:18:59.855879502 (105h53m21.814976736s) [upload=110337]: Upload finished. err: <nil> Duration:* 833.114415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.087698771s FAIL (2025-08-13 03:19:00 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.08773838s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 731.245532ms FAIL (2025-08-13 03:19:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after c124cad1373443148a93c4b560eeb83af4cfec61df5b407dae11bfb2b598bb47 != before 8ef288d0a9b274a3b23a83edbc7582b37ee851911a59b44b8c71af5262134b04 ======LOGS====== Aug 13 03:18:59.707249605 (105h53m21.666346851s) [upload=110337]: Starting upload Aug 13 03:18:59.707337651 (105h53m21.666434899s) [upload=110337]: Done starting upload Aug 13 03:18:59.707416879 (105h53m21.666514173s) [upload=110337]: Uploading segments... Aug 13 03:18:59.707484976 (105h53m21.66658223s) [upload=110337]: Got next segment. Inline: true Aug 13 03:18:59.707490998 (105h53m21.666588243s) [upload=110337]: Waiting for error group managing segments... Aug 13 03:18:59.707538357 (105h53m21.666635603s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:18:59.707543265 (105h53m21.66664051s) [upload=110337]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:18:59.707546744 (105h53m21.666643989s) [upload=110337]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:18:59.855858884 (105h53m21.814956123s) [upload=110337]: Done uploading segments... Aug 13 03:18:59.855879502 (105h53m21.814976736s) [upload=110337]: Upload finished. err: <nil> Duration:* 731.278536ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 829.59525ms FAIL (2025-08-13 03:18:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:16:52.614052789 (105h51m14.573150022s) [upload=110298]: Starting upload Aug 13 03:16:52.614133082 (105h51m14.573230331s) [upload=110298]: Done starting upload Aug 13 03:16:52.614223612 (105h51m14.57332085s) [upload=110298]: Uploading segments... Aug 13 03:16:52.614274107 (105h51m14.573371362s) [upload=110298]: Got next segment. Inline: true Aug 13 03:16:52.614280021 (105h51m14.573377257s) [upload=110298]: Waiting for error group managing segments... Aug 13 03:16:52.614335731 (105h51m14.573432968s) [upload=110298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:16:52.614345612 (105h51m14.573442848s) [upload=110298]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:16:52.614349059 (105h51m14.573446305s) [upload=110298]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:16:52.775367041 (105h51m14.734464287s) [upload=110298]: Done uploading segments... Aug 13 03:16:52.775404231 (105h51m14.734501476s) [upload=110298]: Upload finished. err: <nil> Duration:* 829.627738ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.299314858s FAIL (2025-08-13 03:18:38 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.299343483s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [....X.....X.........................X........X....XX........] duration: 2.607131362s FAIL (2025-08-13 03:18:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.607152932s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....X.....X.........................X........X....XX.......] duration: 2.436703649s FAIL (2025-08-13 03:18:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.436736716s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 852.670257ms FAIL (2025-08-13 03:17:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:16:52.614052789 (105h51m14.573150022s) [upload=110298]: Starting upload Aug 13 03:16:52.614133082 (105h51m14.573230331s) [upload=110298]: Done starting upload Aug 13 03:16:52.614223612 (105h51m14.57332085s) [upload=110298]: Uploading segments... Aug 13 03:16:52.614274107 (105h51m14.573371362s) [upload=110298]: Got next segment. Inline: true Aug 13 03:16:52.614280021 (105h51m14.573377257s) [upload=110298]: Waiting for error group managing segments... Aug 13 03:16:52.614335731 (105h51m14.573432968s) [upload=110298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:16:52.614345612 (105h51m14.573442848s) [upload=110298]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:16:52.614349059 (105h51m14.573446305s) [upload=110298]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:16:52.775367041 (105h51m14.734464287s) [upload=110298]: Done uploading segments... Aug 13 03:16:52.775404231 (105h51m14.734501476s) [upload=110298]: Upload finished. err: <nil> Duration:* 852.687854ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [......X.....X.........................X........X....XX......] duration: 2.547249143s FAIL (2025-08-13 03:17:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.547282053s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.468978749s FAIL (2025-08-13 03:17:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.469014886s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 624.18341ms FAIL (2025-08-13 03:16:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:16:52.614052789 (105h51m14.573150022s) [upload=110298]: Starting upload Aug 13 03:16:52.614133082 (105h51m14.573230331s) [upload=110298]: Done starting upload Aug 13 03:16:52.614223612 (105h51m14.57332085s) [upload=110298]: Uploading segments... Aug 13 03:16:52.614274107 (105h51m14.573371362s) [upload=110298]: Got next segment. Inline: true Aug 13 03:16:52.614280021 (105h51m14.573377257s) [upload=110298]: Waiting for error group managing segments... Aug 13 03:16:52.614335731 (105h51m14.573432968s) [upload=110298]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:16:52.614345612 (105h51m14.573442848s) [upload=110298]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:16:52.614349059 (105h51m14.573446305s) [upload=110298]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:16:52.775367041 (105h51m14.734464287s) [upload=110298]: Done uploading segments... Aug 13 03:16:52.775404231 (105h51m14.734501476s) [upload=110298]: Upload finished. err: <nil> Duration:* 624.215626ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.......X.....X.........................X........X....XX.....] duration: 2.494719319s FAIL (2025-08-13 03:16:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.494746334s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.135586372s FAIL (2025-08-13 03:16:15 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.135623267s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [........X.....X.........................X........X....XX....] duration: 2.350690078s FAIL (2025-08-13 03:15:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.350728546s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.202757262s FAIL (2025-08-13 03:15:20 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.202789011s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.........X.....X.........................X........X....XX...] duration: 2.388150702s FAIL (2025-08-13 03:14:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.388181912s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.487270732s FAIL (2025-08-13 03:14:11 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.487361417s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..........X.....X.........................X........X....XX..] duration: 2.522523189s FAIL (2025-08-13 03:13:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.522559384s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.314919841s FAIL (2025-08-13 03:13:18 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.314952459s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...........X.....X.........................X........X....XX.] duration: 2.425306024s FAIL (2025-08-13 03:12:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.425492703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.407618562s FAIL (2025-08-13 03:12:56 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.407663224s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [............X.....X.........................X........X....XX] duration: 1.838623532s FAIL (2025-08-13 03:12:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 1.838656745s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.515410113s FAIL (2025-08-13 03:12:27 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.515450691s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X.....X.........................X........X....X] duration: 367.375953ms FAIL (2025-08-13 03:12:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:12:20.245775781 (105h46m42.204873031s) [upload=110223]: Starting upload Aug 13 03:12:20.245851976 (105h46m42.204949225s) [upload=110223]: Done starting upload Aug 13 03:12:20.245954698 (105h46m42.20505195s) [upload=110223]: Uploading segments... Aug 13 03:12:20.246262582 (105h46m42.205359831s) [upload=110223]: Got next segment. Inline: false Aug 13 03:12:20.246332002 (105h46m42.205429255s) [upload=110223]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:20.246339145 (105h46m42.205436398s) [upload=110223]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:20.336351535 (105h46m42.29544879s) [upload=110223]: Next segment err: metaclient: Too Many Requests Aug 13 03:12:20.336401873 (105h46m42.29549912s) [upload=110223]: Done uploading segments... Aug 13 03:12:20.336422358 (105h46m42.295519608s) [upload=110223]: Upload finished. err: metaclient: Too Many Requests Duration: 367.402883ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.164385497s FAIL (2025-08-13 03:12:05 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.164421607s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.354669862s FAIL (2025-08-13 03:11:08 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.354703805s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.....X.........................X........X....] duration: 2.480032546s FAIL (2025-08-13 03:11:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:08:20.246192878 (105h42m42.205290125s) [upload=110162]: Starting upload Aug 13 03:08:20.246286836 (105h42m42.205384081s) [upload=110162]: Done starting upload Aug 13 03:08:20.246436085 (105h42m42.20553336s) [upload=110162]: Uploading segments... Aug 13 03:08:20.246753013 (105h42m42.205850256s) [upload=110162]: Got next segment. Inline: false Aug 13 03:08:20.246836821 (105h42m42.205934066s) [upload=110162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:08:20.246846778 (105h42m42.205944027s) [upload=110162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:08:20.335823166 (105h42m42.2949204s) [upload=110162]: Next segment err: metaclient: Too Many Requests Aug 13 03:08:20.335854947 (105h42m42.29495218s) [upload=110162]: Done uploading segments... Aug 13 03:08:20.335890642 (105h42m42.294987887s) [upload=110162]: Upload finished. err: metaclient: Too Many Requests Duration: 2.480153291s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X.....X.........................X........X...] duration: 2.479529758s FAIL (2025-08-13 03:10:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:08:20.246192878 (105h42m42.205290125s) [upload=110162]: Starting upload Aug 13 03:08:20.246286836 (105h42m42.205384081s) [upload=110162]: Done starting upload Aug 13 03:08:20.246436085 (105h42m42.20553336s) [upload=110162]: Uploading segments... Aug 13 03:08:20.246753013 (105h42m42.205850256s) [upload=110162]: Got next segment. Inline: false Aug 13 03:08:20.246836821 (105h42m42.205934066s) [upload=110162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:08:20.246846778 (105h42m42.205944027s) [upload=110162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:08:20.335823166 (105h42m42.2949204s) [upload=110162]: Next segment err: metaclient: Too Many Requests Aug 13 03:08:20.335854947 (105h42m42.29495218s) [upload=110162]: Done uploading segments... Aug 13 03:08:20.335890642 (105h42m42.294987887s) [upload=110162]: Upload finished. err: metaclient: Too Many Requests Duration: 2.479562566s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.312728803s FAIL (2025-08-13 03:10:44 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.312767577s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X.....X.........................X........X..] duration: 2.430395503s FAIL (2025-08-13 03:10:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:08:20.246192878 (105h42m42.205290125s) [upload=110162]: Starting upload Aug 13 03:08:20.246286836 (105h42m42.205384081s) [upload=110162]: Done starting upload Aug 13 03:08:20.246436085 (105h42m42.20553336s) [upload=110162]: Uploading segments... Aug 13 03:08:20.246753013 (105h42m42.205850256s) [upload=110162]: Got next segment. Inline: false Aug 13 03:08:20.246836821 (105h42m42.205934066s) [upload=110162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:08:20.246846778 (105h42m42.205944027s) [upload=110162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:08:20.335823166 (105h42m42.2949204s) [upload=110162]: Next segment err: metaclient: Too Many Requests Aug 13 03:08:20.335854947 (105h42m42.29495218s) [upload=110162]: Done uploading segments... Aug 13 03:08:20.335890642 (105h42m42.294987887s) [upload=110162]: Upload finished. err: metaclient: Too Many Requests Duration: 2.430422599s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.340590415s FAIL (2025-08-13 03:10:00 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.340628696s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 875.632408ms FAIL (2025-08-13 03:09:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 875.667305ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X.....X.........................X........X.] duration: 2.681115285s FAIL (2025-08-13 03:09:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:08:20.246192878 (105h42m42.205290125s) [upload=110162]: Starting upload Aug 13 03:08:20.246286836 (105h42m42.205384081s) [upload=110162]: Done starting upload Aug 13 03:08:20.246436085 (105h42m42.20553336s) [upload=110162]: Uploading segments... Aug 13 03:08:20.246753013 (105h42m42.205850256s) [upload=110162]: Got next segment. Inline: false Aug 13 03:08:20.246836821 (105h42m42.205934066s) [upload=110162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:08:20.246846778 (105h42m42.205944027s) [upload=110162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:08:20.335823166 (105h42m42.2949204s) [upload=110162]: Next segment err: metaclient: Too Many Requests Aug 13 03:08:20.335854947 (105h42m42.29495218s) [upload=110162]: Done uploading segments... Aug 13 03:08:20.335890642 (105h42m42.294987887s) [upload=110162]: Upload finished. err: metaclient: Too Many Requests Duration: 2.681232353s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 861.690921ms FAIL (2025-08-13 03:09:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 861.721939ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 885.682156ms FAIL (2025-08-13 03:08:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 885.738249ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.457081343s FAIL (2025-08-13 03:08:51 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.457114884s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X.....X.........................X........X] duration: 376.828078ms FAIL (2025-08-13 03:08:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 03:08:20.246192878 (105h42m42.205290125s) [upload=110162]: Starting upload Aug 13 03:08:20.246286836 (105h42m42.205384081s) [upload=110162]: Done starting upload Aug 13 03:08:20.246436085 (105h42m42.20553336s) [upload=110162]: Uploading segments... Aug 13 03:08:20.246753013 (105h42m42.205850256s) [upload=110162]: Got next segment. Inline: false Aug 13 03:08:20.246836821 (105h42m42.205934066s) [upload=110162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:08:20.246846778 (105h42m42.205944027s) [upload=110162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:08:20.335823166 (105h42m42.2949204s) [upload=110162]: Next segment err: metaclient: Too Many Requests Aug 13 03:08:20.335854947 (105h42m42.29495218s) [upload=110162]: Done uploading segments... Aug 13 03:08:20.335890642 (105h42m42.294987887s) [upload=110162]: Upload finished. err: metaclient: Too Many Requests Duration: 376.851575ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.012771286s FAIL (2025-08-13 03:08:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 1.012813115s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.215076343s FAIL (2025-08-13 03:08:05 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.215103382s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 853.644886ms FAIL (2025-08-13 03:07:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 853.675631ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.101079014s FAIL (2025-08-13 03:07:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab720b69fda32ad32f99e91895dfea831bf7aaa323e4716bf82962fdf6a2bfae != before 9299353fd1630ece7618633353443b763dab013c9a987f9e0fb7eab3ddc87267 ======LOGS====== Aug 13 02:31:46.345746219 (105h6m8.304843477s) [upload=109513]: Starting upload Aug 13 02:31:46.345835071 (105h6m8.304932331s) [upload=109513]: Done starting upload Aug 13 02:31:46.345980343 (105h6m8.305077588s) [upload=109513]: Uploading segments... Aug 13 02:31:46.346048518 (105h6m8.305145772s) [upload=109513]: Got next segment. Inline: true Aug 13 02:31:46.346057681 (105h6m8.305154929s) [upload=109513]: Waiting for error group managing segments... Aug 13 02:31:46.346112429 (105h6m8.305209678s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 02:31:46.346121254 (105h6m8.305218509s) [upload=109513]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 02:31:46.346126820 (105h6m8.305224072s) [upload=109513]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 02:31:46.650173640 (105h6m8.609270888s) [upload=109513]: Done uploading segments... Aug 13 02:31:46.650194753 (105h6m8.609291992s) [upload=109513]: Upload finished. err: <nil> Duration:* 1.101115204s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.44051057s FAIL (2025-08-13 03:07:18 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.440544056s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)