Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..................X..X...X....................X.............] duration: 873.663654ms FAIL (2025-08-13 03:46:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 873.695828ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X....XX.............................................] duration: 2.536057037s FAIL (2025-08-13 03:45:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.536099948s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.529773976s FAIL (2025-08-13 03:45:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.529812601s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...................X..X...X....................X............] duration: 855.870716ms FAIL (2025-08-13 03:44:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 855.92482ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X........X....XX............................................] duration: 2.561505652s FAIL (2025-08-13 03:44:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.561540726s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X........X....XX...........................................] duration: 2.68308565s FAIL (2025-08-13 03:44:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.683121307s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.158916159s FAIL (2025-08-13 03:44:19 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.159124041s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.418801069s FAIL (2025-08-13 03:44:01 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.418842349s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X........X....XX..........................................] duration: 2.407515192s FAIL (2025-08-13 03:43:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.407600573s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....................X..X...X....................X...........] duration: 966.444158ms FAIL (2025-08-13 03:43:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 966.475597ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X........X....XX.........................................] duration: 2.334586783s FAIL (2025-08-13 03:43:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.334619696s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....................X..X...X....................X..........] duration: 997.244061ms FAIL (2025-08-13 03:43:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 997.27959ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.133016147s FAIL (2025-08-13 03:43:14 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.13306309s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X..X...X....................X.........] duration: 953.423766ms FAIL (2025-08-13 03:43:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 953.477666ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X........X....XX........................................] duration: 2.323515939s FAIL (2025-08-13 03:42:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.323545762s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..X...X....................X........] duration: 852.263319ms FAIL (2025-08-13 03:42:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 852.292744ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.245119967s FAIL (2025-08-13 03:42:01 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.245157251s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X........X....XX.......................................] duration: 2.468501705s FAIL (2025-08-13 03:41:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.468531761s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................X..X...X....................X.......] duration: 878.862836ms FAIL (2025-08-13 03:41:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 878.890257ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.110247243s FAIL (2025-08-13 03:41:23 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.11027953s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........................X..X...X....................X......] duration: 864.324819ms FAIL (2025-08-13 03:40:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 864.368575ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X........X....XX......................................] duration: 2.480128473s FAIL (2025-08-13 03:40:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.480157732s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.277130975s FAIL (2025-08-13 03:40:32 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.277179311s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........................X..X...X....................X.....] duration: 939.850322ms FAIL (2025-08-13 03:40:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 939.891182ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X........X....XX.....................................] duration: 2.360991044s FAIL (2025-08-13 03:39:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.361021447s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.319467243s FAIL (2025-08-13 03:39:40 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.319508304s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................X..X...X....................X....] duration: 913.78535ms FAIL (2025-08-13 03:39:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 913.818599ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X........X....XX....................................] duration: 2.634561658s FAIL (2025-08-13 03:39:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.634594219s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............................X..X...X....................X...] duration: 937.377054ms FAIL (2025-08-13 03:38:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 937.414731ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.390111847s FAIL (2025-08-13 03:38:51 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.390291225s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.023479644s FAIL (2025-08-13 03:38:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.023522053s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X........X....XX...................................] duration: 2.506381886s FAIL (2025-08-13 03:38:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.50641153s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............................X..X...X....................X..] duration: 838.70511ms FAIL (2025-08-13 03:37:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 838.737893ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.383733082s FAIL (2025-08-13 03:37:51 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.383769015s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X........X....XX..................................] duration: 2.718475215s FAIL (2025-08-13 03:37:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.71851139s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.057383966s FAIL (2025-08-13 03:37:13 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.057418386s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............................X..X...X....................X.] duration: 955.306111ms FAIL (2025-08-13 03:37:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 955.344987ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X........X....XX.................................] duration: 2.625273174s FAIL (2025-08-13 03:36:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.625427818s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.458011029s FAIL (2025-08-13 03:36:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.458100878s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X........X....XX................................] duration: 2.639137876s FAIL (2025-08-13 03:36:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.639170129s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............................X..X...X....................X] duration: 685.120245ms FAIL (2025-08-13 03:36:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 03:36:28.809188663 (106h10m50.768285919s) [upload=110625]: Starting upload Aug 13 03:36:28.809288903 (106h10m50.768386159s) [upload=110625]: Done starting upload Aug 13 03:36:28.809390197 (106h10m50.768487445s) [upload=110625]: Uploading segments... Aug 13 03:36:28.809461843 (106h10m50.768559096s) [upload=110625]: Got next segment. Inline: true Aug 13 03:36:28.809468503 (106h10m50.768565755s) [upload=110625]: Waiting for error group managing segments... Aug 13 03:36:28.809540502 (106h10m50.76863776s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:36:28.809547343 (106h10m50.768644599s) [upload=110625]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:36:28.809551350 (106h10m50.768648607s) [upload=110625]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:36:29.012399829 (106h10m50.971497074s) [upload=110625]: Done uploading segments... Aug 13 03:36:29.012426955 (106h10m50.971524191s) [upload=110625]: Upload finished. err: <nil> Duration:* 685.153532ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X..X...X....................] duration: 946.34488ms FAIL (2025-08-13 03:35:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 946.382511ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.322192885s FAIL (2025-08-13 03:35:45 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.322245776s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X........X....XX...............................] duration: 2.584065316s FAIL (2025-08-13 03:35:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.584103882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..X...X...................] duration: 930.986819ms FAIL (2025-08-13 03:35:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 931.022804ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.190805995s FAIL (2025-08-13 03:35:21 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.190849207s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X........X....XX..............................] duration: 2.462251603s FAIL (2025-08-13 03:34:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.462288765s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X........X....XX.............................] duration: 2.481293798s FAIL (2025-08-13 03:34:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 13 03:12:41.439675232 (105h47m3.398772467s) [upload=110230]: Starting upload Aug 13 03:12:41.439754463 (105h47m3.39885171s) [upload=110230]: Done starting upload Aug 13 03:12:41.439897739 (105h47m3.398994971s) [upload=110230]: Uploading segments... Aug 13 03:12:41.440277162 (105h47m3.399374394s) [upload=110230]: Got next segment. Inline: false Aug 13 03:12:41.440338396 (105h47m3.399435629s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:12:41.440343953 (105h47m3.3994412s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 13 03:12:41.724394741 (105h47m3.683491993s) [seg_pos={0 0}, upload=110230]: Begin upload segment... Aug 13 03:12:41.724451215 (105h47m3.683548452s) [seg_pos={0 0}, upload=110230]: Done begin upload segment. Aug 13 03:12:41.724484655 (105h47m3.683581905s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.724503257 (105h47m3.683600535s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725011358 (105h47m3.684108611s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725563131 (105h47m3.684660386s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725690902 (105h47m3.684788152s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.725941887 (105h47m3.685039139s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726103881 (105h47m3.685201128s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726239198 (105h47m3.685336443s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726450018 (105h47m3.685547265s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.726790331 (105h47m3.685887578s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727120686 (105h47m3.686217935s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727450588 (105h47m3.686547838s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727770937 (105h47m3.686868187s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.727941234 (105h47m3.687038485s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728372041 (105h47m3.687469295s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728737797 (105h47m3.687835051s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.728962262 (105h47m3.688059512s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:41.729341698 (105h47m3.688438947s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Uploading piece... Aug 13 03:12:42.256437431 (105h47m4.215534687s) [upload=110230]: Next returned nil segment Aug 13 03:12:42.256458837 (105h47m4.215556094s) [upload=110230]: Waiting for error group managing segments... Aug 13 03:12:42.436730019 (105h47m4.395827257s) [noise=true , address=77.90.31.13:4660 , piece_id=2ZB2R6G5JPJALWBP2JXILDRNR5WXWZD5IXUG7QZ4HI5UZMMNRAVQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.450225209 (105h47m4.409322446s) [noise=true , address=77.90.31.17:4781 , piece_id=F54IDMPA7IHBBGXOTKW253JKBVFBKXFCAWBZ26E53EIVQRAWW4WA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.461898015 (105h47m4.420995246s) [noise=true , address=45.91.116.7:4035 , piece_id=43BUFMEAQGXTAK2F675KUCXKDKRF5I3G5TMFDVD4OGWQJGP55V3Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464132323 (105h47m4.423229568s) [noise=true , address=104.36.82.62:4443 , piece_id=6G6UNMW5V36LCCP65BBKB4LEDE3NAUWGTDUUHDUSJHHRRLGUQO2Q, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.464367203 (105h47m4.423464451s) [noise=true , address=77.90.31.13:4659 , piece_id=T4RTQJY2JF7IDAO7INJP5U5S5BNDGWX5GB3EQXVAFP4KPDT4232A, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467035635 (105h47m4.42613288s) [noise=true , address=77.90.31.21:4895 , piece_id=FQNLHTRY4DKFYDT7A62GEKFVAZJ7VFDW32ZNCVSOR4K3XJFDIAIA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.467919108 (105h47m4.427016357s) [noise=true , address=104.36.82.2:4757 , piece_id=VFHMEQEYKWM6RKIES4W7HPSK6KJ2NWTJ5OL4MQNUMATWGNHRMWDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.470468561 (105h47m4.429565799s) [noise=true , address=104.36.82.60:4351 , piece_id=PMW2KLDUGLI6EWOMR5I4LKXF4CMWZPKHUOHFX36EQBGR5TO7UNCA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.474713453 (105h47m4.433810689s) [noise=true , address=104.36.82.46:4486 , piece_id=2LCZU7MMPM357JACKDZBJYQMF2YVNARTMI4W6Z3Y4AHXZDBCOJMQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.483855607 (105h47m4.442952838s) [noise=true , address=104.36.82.39:4742 , piece_id=RFHF6URQJSXJWQVDBLAAZL6YY57EEMJWUOJXMOZ4ZRZZBMJJTBIQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488262440 (105h47m4.447359695s) [noise=true , address=104.36.82.50:4018 , piece_id=UDDRLTWSFI2ZT3CRGZHXDK7WH5OLTLMASCEM5AFRNR74OV434YLQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.488332446 (105h47m4.447429687s) [noise=true , address=104.36.82.58:4265 , piece_id=SIDBS3DCZKT6OW7EBLFXADYK42U32M5VK52QXND55GE5I4ZHMPOQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.497825756 (105h47m4.456923006s) [noise=true , address=104.36.82.62:4430 , piece_id=FJ6SCKKXIZHDNIC3KOOETQLOLZERGLJGQAMBZIJ2MCYRFI3CQETA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507014892 (105h47m4.46611213s) [noise=true , address=104.36.82.61:4406 , piece_id=4X4FD4JKXTKK6QZJYN5LG2HENZHJAH33MPBKV5UGEEANIW6WH6QA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: <nil> Aug 13 03:12:42.507044692 (105h47m4.466141937s) [seg_pos={0 0}, upload=110230]: Segment reached optimal threshold of 14 pieces. Aug 13 03:12:42.507265718 (105h47m4.466362957s) [noise=true , address=104.36.82.4:4835 , piece_id=6FFESP7NSIJL2W3LQKFBUJH66ZOWCPV3BB337WVADD4QCXUSBSTA, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WYQwhW2KDjDyweEx5FLYRkGwvW15f6eVHzbdrysiHeuKNtaoN): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507604459 (105h47m4.466701712s) [noise=true , address=104.36.82.23:4469 , piece_id=AX5HQGRJ2ETPUFAPXC3KASRPM6I246CUGJJSMLL7H4NZ63EF7OWQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507818621 (105h47m4.466915861s) [noise=true , address=64.49.13.139:4469 , piece_id=VCOWZNOI6FQDOJ3T56PDIANUBLEEE26EZVF2CZKJWZ3W7CDERXUQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60816->64.49.13.139:4469: use of closed network connection Aug 13 03:12:42.507884562 (105h47m4.466981801s) [noise=true , address=104.36.82.47:4540 , piece_id=SO4BXC2QOC3BPMVUDO2H5LN5MK6HLIDJLGG2GP7JF4XX7I2FJYDQ, seg_pos={0 0}, upload=110230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: expected piece hash; context canceled; EOF Aug 13 03:12:42.507900787 (105h47m4.466998023s) [seg_pos={0 0}, upload=110230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 13 03:12:42.508001289 (105h47m4.467098523s) [upload=110230]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 13 03:12:42.508006910 (105h47m4.467104156s) [upload=110230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:12:42.657903131 (105h47m4.617000387s) [upload=110230]: Done uploading segments... Aug 13 03:12:42.657961200 (105h47m4.617058451s) [upload=110230]: Upload finished. err: <nil> Duration: 2.481332536s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..X...X..................] duration: 840.235718ms FAIL (2025-08-13 03:34:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 8766a174fd70792fbc0b7891d8a1dd33c4c574bad2dbd6b99e5625b359ba00cd != before 5235e0bdfc793af1c4f735b4c1f8daaf98ba001b8caf2bf3896d85469502af92 ======LOGS====== Aug 13 03:21:49.848056865 (105h56m11.807154111s) [upload=110383]: Starting upload Aug 13 03:21:49.848108775 (105h56m11.80720602s) [upload=110383]: Done starting upload Aug 13 03:21:49.848183760 (105h56m11.807280998s) [upload=110383]: Uploading segments... Aug 13 03:21:49.848264900 (105h56m11.807362154s) [upload=110383]: Got next segment. Inline: true Aug 13 03:21:49.848271635 (105h56m11.80736888s) [upload=110383]: Waiting for error group managing segments... Aug 13 03:21:49.848335675 (105h56m11.807432912s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 13 03:21:49.848341205 (105h56m11.807438441s) [upload=110383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 13 03:21:49.848344735 (105h56m11.80744197s) [upload=110383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 13 03:21:50.020282216 (105h56m11.979379462s) [upload=110383]: Done uploading segments... Aug 13 03:21:50.020313928 (105h56m11.979411162s) [upload=110383]: Upload finished. err: <nil> Duration:* 840.25846ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.044525628s FAIL (2025-08-13 03:34:13 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.044577817s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)