Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X..X...X.................] duration: 915.825532ms FAIL (2025-08-13 03:33:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 915.860516ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X........X....XX............................] duration: 2.568914032s FAIL (2025-08-13 03:33:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.568951861s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.341887367s FAIL (2025-08-13 03:33:23 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.341926672s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X..X...X................] duration: 927.129124ms FAIL (2025-08-13 03:33:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 927.158153ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.33519358s FAIL (2025-08-13 03:32:29 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.335302556s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X........X....XX...........................] duration: 2.456841925s FAIL (2025-08-13 03:32:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.456876285s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X..X...X...............] duration: 864.219596ms FAIL (2025-08-13 03:32:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 864.247555ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................X..X...X..............] duration: 1.144607892s FAIL (2025-08-13 03:31:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 1.144639132s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.185230601s FAIL (2025-08-13 03:31:43 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.185259248s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X........X....XX..........................] duration: 2.502210845s FAIL (2025-08-13 03:31:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.502251089s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.483336344s FAIL (2025-08-13 03:31:12 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.483374167s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X..X...X.............] duration: 1.087410905s FAIL (2025-08-13 03:31:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 1.08743141s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X........X....XX.........................] duration: 2.721532543s FAIL (2025-08-13 03:31:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.721565079s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.2557562s FAIL (2025-08-13 03:30:46 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.255789142s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X........X....XX........................] duration: 2.636746438s FAIL (2025-08-13 03:30:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.636792306s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................................X..X...X............] duration: 1.038232969s FAIL (2025-08-13 03:30:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 1.038261586s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X........X....XX.......................] duration: 2.544618125s FAIL (2025-08-13 03:30:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.544711288s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X..X...X...........] duration: 871.387597ms FAIL (2025-08-13 03:29:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 871.439599ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.568518811s FAIL (2025-08-13 03:29:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.568559885s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X........X....XX......................] duration: 2.256195163s FAIL (2025-08-13 03:29:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.256244747s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X..X...X..........] duration: 841.235212ms FAIL (2025-08-13 03:29:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 841.277514ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X........X....XX.....................] duration: 2.609382969s FAIL (2025-08-13 03:29:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.609427917s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.334396621s FAIL (2025-08-13 03:29:03 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.334435171s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X........X....XX....................] duration: 2.476232526s FAIL (2025-08-13 03:28:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.476271603s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X..X...X.........] duration: 912.140604ms FAIL (2025-08-13 03:28:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 912.171608ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.275339885s FAIL (2025-08-13 03:27:51 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.275385231s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X........X....XX...................] duration: 2.531282858s FAIL (2025-08-13 03:27:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.531319622s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................................X..X...X........] duration: 1.296482412s FAIL (2025-08-13 03:27:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 1.296522961s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X..X...X.......] duration: 841.79518ms FAIL (2025-08-13 03:27:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 841.828806ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.21337152s FAIL (2025-08-13 03:26:50 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.213408149s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.........................X........X....XX..................] duration: 2.50746451s FAIL (2025-08-13 03:26:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.507498517s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.388442845s FAIL (2025-08-13 03:26:10 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.388480392s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X..X...X......] duration: 879.504969ms FAIL (2025-08-13 03:26:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 879.59989ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.........................X........X....XX.................] duration: 2.771914743s FAIL (2025-08-13 03:25:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.772014605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.364597089s FAIL (2025-08-13 03:25:15 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.364635497s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.........................X........X....XX................] duration: 2.451621278s FAIL (2025-08-13 03:25:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.451664873s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X..X...X.....] duration: 878.772692ms FAIL (2025-08-13 03:25:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 878.80413ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.........................X........X....XX...............] duration: 2.468173793s FAIL (2025-08-13 03:24:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.468331309s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.32524393s FAIL (2025-08-13 03:24:42 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.325373241s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................................X..X...X....] duration: 1.174961119s FAIL (2025-08-13 03:24:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 1.174985072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.758788689s FAIL (2025-08-13 03:23:49 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.758824039s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.........................X........X....XX..............] duration: 2.489401406s FAIL (2025-08-13 03:23:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.489435088s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................................X..X...X...] duration: 867.691319ms FAIL (2025-08-13 03:23:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 867.771677ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................................X..X...X..] duration: 885.767403ms FAIL (2025-08-13 03:22:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 885.797709ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.........................X........X....XX.............] duration: 2.430013103s FAIL (2025-08-13 03:22:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.430088834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.33632497s FAIL (2025-08-13 03:22:42 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.336357004s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................................X..X...X.] duration: 1.455458013s FAIL (2025-08-13 03:22:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 1.455548729s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X.....X.........................X........X....XX............] duration: 2.56805436s FAIL (2025-08-13 03:22:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.568089107s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.182033354s FAIL (2025-08-13 03:21:56 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.182070424s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................................X..X...X] duration: 739.06435ms FAIL (2025-08-13 03:21:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 739.093838ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)