Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration: 2.876157796s FAIL (2025-06-25 23:32:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.876186145s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................X......................] duration: 3.090038356s FAIL (2025-06-25 23:31:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.090077874s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................X.....................] duration: 4.617856406s FAIL (2025-06-25 23:30:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.617887673s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................X......................X....................] duration: 3.468913451s FAIL (2025-06-25 23:29:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.468945078s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................X...................] duration: 3.075386735s FAIL (2025-06-25 23:28:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.075417572s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................X..................] duration: 46.011125248s FAIL (2025-06-25 23:28:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 46.01115318s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................X.................] duration: 4.842449933s FAIL (2025-06-25 23:27:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.842480926s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................X................] duration: 3.001273668s FAIL (2025-06-25 23:26:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.001303163s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration: 9.86041304s FAIL (2025-06-25 23:26:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 9.860459233s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................X......................X..............] duration: 2.394078063s FAIL (2025-06-25 23:25:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.394115064s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration: 4.46517124s FAIL (2025-06-25 23:24:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.465201618s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................X......................X............] duration: 2.844724217s FAIL (2025-06-25 23:23:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.844753993s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration: 4.760092158s FAIL (2025-06-25 23:22:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.760119277s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration: 3.642953027s FAIL (2025-06-25 23:21:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.642983671s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration: 2.844941525s FAIL (2025-06-25 23:21:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.845045439s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................X......................X........] duration: 2.566295265s FAIL (2025-06-25 23:20:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.56632948s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration: 2.548972314s FAIL (2025-06-25 23:20:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.549005511s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................X......................X......] duration: 4.154398409s FAIL (2025-06-25 23:19:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.154426547s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................X......................X.....] duration: 2.600059843s FAIL (2025-06-25 23:18:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.600153593s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................X......................X....] duration: 3.453714961s FAIL (2025-06-25 23:17:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.453749891s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................X......................X...] duration: 3.162526888s FAIL (2025-06-25 23:16:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.163212378s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................X......................X..] duration: 2.587799716s FAIL (2025-06-25 23:15:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.587828441s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................X......................X.] duration: 6.092157753s FAIL (2025-06-25 23:15:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 6.092184213s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................X......................X] duration: 1m0.118019413s FAIL (2025-06-25 23:14:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 1m0.118047041s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.523656728s FAIL (2025-06-25 23:13:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 4.523688527s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.750301869s FAIL (2025-06-25 23:12:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 5.750339297s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.186532353s FAIL (2025-06-25 23:12:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.186619465s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 3.106278979s FAIL (2025-06-25 23:11:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.106317188s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.85050585s FAIL (2025-06-25 23:10:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.850536436s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.862568986s FAIL (2025-06-25 23:09:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.86259601s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.504792804s FAIL (2025-06-25 23:08:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 6.504835334s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 7.071651015s FAIL (2025-06-25 23:08:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.071697561s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 7.653012234s FAIL (2025-06-25 23:07:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.653046548s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 7.535021554s FAIL (2025-06-25 23:06:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 7.535053739s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.9737768s FAIL (2025-06-25 23:05:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.973829713s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.138392425s FAIL (2025-06-25 23:04:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.13843635s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.430858141s FAIL (2025-06-25 23:04:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.430884959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.18957792s FAIL (2025-06-25 23:03:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.18962663s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 3.094705717s FAIL (2025-06-25 23:02:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.094743516s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 3.590116942s FAIL (2025-06-25 23:01:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.590144861s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.91490419s FAIL (2025-06-25 23:00:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.914939276s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 3.24419066s FAIL (2025-06-25 23:00:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.244224199s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.036042557s FAIL (2025-06-25 22:59:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 4.036073903s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.708193407s FAIL (2025-06-25 22:58:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.708221412s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.313854009s FAIL (2025-06-25 22:58:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.313885875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.824553719s FAIL (2025-06-25 22:57:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 2.824574215s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.126883794s FAIL (2025-06-25 22:57:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 030721870 (61h44m47.914135489s) [upload=49421]: Done uploading segments... Jun 25 22:55:48.030751360 (61h44m47.91416498s) [upload=49421]: Upload finished. err: <nil> Jun 25 22:56:19.497633523 (61h45m19.381047139s) [upload=49427]: Starting upload Jun 25 22:56:19.497789471 (61h45m19.381203091s) [upload=49427]: Done starting upload Jun 25 22:56:19.498003063 (61h45m19.381416682s) [upload=49427]: Uploading segments... Jun 25 22:56:19.498358243 (61h45m19.38177186s) [upload=49427]: Got next segment. Inline: false Jun 25 22:56:19.498428587 (61h45m19.381842206s) [upload=49427]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 22:56:19.498435341 (61h45m19.381848958s) [upload=49427]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 22:56:19.694293373 (61h45m19.577707011s) [seg_pos={0 0}, upload=49427]: Begin upload segment... Jun 25 22:56:19.694379730 (61h45m19.577793363s) [seg_pos={0 0}, upload=49427]: Done begin upload segment. Jun 25 22:56:19.694409923 (61h45m19.577823553s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.694436933 (61h45m19.577850565s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.695164358 (61h45m19.578577976s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698009208 (61h45m19.58142284s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698088883 (61h45m19.58150252s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698399082 (61h45m19.581812711s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698706393 (61h45m19.582120041s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.698894226 (61h45m19.582307857s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699212022 (61h45m19.582625653s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699338797 (61h45m19.582752431s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699504154 (61h45m19.582917783s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699829298 (61h45m19.583242934s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.699888149 (61h45m19.583301779s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700158518 (61h45m19.583572152s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700487241 (61h45m19.583900871s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.700794619 (61h45m19.584208248s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701147816 (61h45m19.584561449s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:19.701461103 (61h45m19.584874732s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Uploading piece... Jun 25 22:56:20.230039636 (61h45m20.113453252s) [upload=49427]: Next returned nil segment Jun 25 22:56:20.230059196 (61h45m20.113472817s) [upload=49427]: Waiting for error group managing segments... Jun 25 22:56:20.379849837 (61h45m20.263263467s) [noise=true , address=104.36.82.58:4289 , piece_id=BITAWAQLK2YJJNQ4DJ3OH5CXEPEHJYHJEW3Q3TT3646FAEE4QTSA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.393666633 (61h45m20.277080254s) [noise=true , address=104.36.82.16:4301 , piece_id=L3YKEMD4JWMP5O2TK5ET2AX5AKUDFXZW5YDQ7VNWJ3KCWEWC7RJA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.399339436 (61h45m20.282753055s) [noise=true , address=104.36.82.37:4677 , piece_id=65HINLHGSAADXD3EEAZZR56BMYYH2BMJVBOYTJBZBPJ3WTIJNPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.419667059 (61h45m20.303080671s) [noise=true , address=104.36.82.42:4817 , piece_id=HHWPDOGR2PSGAKDFV6VAWPZU5EITLOH3BQMUOMAXBROATZUC3NWQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.438659014 (61h45m20.322072651s) [noise=true , address=77.90.31.12:4607 , piece_id=Y3KB6FRFHIYH4LZQUB6JKKM4PYJITXTI7WGFSNYICVCVUYI7RMZQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.462293342 (61h45m20.345706971s) [noise=true , address=104.36.82.14:4251 , piece_id=4VQDYGEE7UKZJTU3O6CJVDR73SBPJFZPIDWREED6QZ52YYHLLSHA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.476622150 (61h45m20.360035778s) [noise=true , address=79.127.219.38:4032 , piece_id=GGXITEFPVD6N2PJL33XHYOLBMX2BP3ZNTSFUMXIRAHNWBSRGLNOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.485314712 (61h45m20.368728328s) [noise=true , address=104.36.82.5:4864 , piece_id=55RUJIOV3EUCIQ75ICLW5N5XAGXLTXDZEYITTP7XAL7VG3OLNFOA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.541439623 (61h45m20.424853239s) [noise=true , address=77.90.31.19:4851 , piece_id=F5KGTHC3SXXIMF5EVF7P2CU76TT4FODYQJEPVPBUOIVQ6NZGMMGA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.675140613 (61h45m20.558554245s) [noise=true , address=77.90.31.18:4810 , piece_id=7R4UMZMCJ4T3XN3N4UWMZCOFLB4O463VQ2273FIXDLCYYRTXWUIQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.928545258 (61h45m20.811958876s) [noise=true , address=79.127.205.234:4601 , piece_id=DPGY6FWYMLGLU6HTFTBWP2O6I3TJOQNJ3MTTOGDJWV4G4EWUIW3A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:20.935420355 (61h45m20.818833968s) [noise=true , address=193.149.164.143:4699 , piece_id=ZRTVZZLZZP5IKDZAYEZQLYMBCKDE5WEBWHBCZTK7IWHC522AOPOQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:56:25.563100929 (61h45m25.446514552s) [noise=true , address=104.36.82.61:4400 , piece_id=WGC4JTVBP6ORUL3726Y2USYP6MSQOS4RSIBJ3LSZF72WBUJSUTQQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: <nil> Jun 25 22:57:19.214285928 (61h46m19.097699555s) [noise=true , address=104.36.82.62:4409 , piece_id=RCRJGXX2I5GJILA4TVZI5CUZ6VEVQ36KG6A2IP2U7RYEA3W6LKCQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:104.36.82.62:4409): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214349655 (61h46m19.097763406s) [noise=true , address=104.36.82.60:4360 , piece_id=H3V2BJUKSEKXQPCOCOT6XUXGOXUPCWA5HAGMYOM3BQLSJNFIU43A, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12T24rtYBJ47E6Ef1ZZKMWcpBrWBpCg5QV2ZHniCZZkzJF2yUNk, address:104.36.82.60:4360): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214418060 (61h46m19.097831684s) [noise=true , address=104.36.82.58:4273 , piece_id=4TEW6AHTHPFEOU75WGHQY7KSDPP27HHNDZBHAGGLTQCIX7WHDSWA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12iN5idncnxwdBp5gdhrxbGcWi184iLJ8QA4HMk5eEEqQBCmSLt, address:104.36.82.58:4273): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214610338 (61h46m19.098023988s) [noise=true , address=104.36.82.59:4309 , piece_id=WJ7GXART6T2W322ENPSB2IHPIVY2PBCNTVXAOUAAXRLS3Z6BUYBA, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1, address:104.36.82.59:4309): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214675054 (61h46m19.098088696s) [noise=true , address=104.36.82.59:4334 , piece_id=B6T66IWESNGZTTXNVBRWK6TJ2PWBKW34JZWNRLYKVI57KZV3LVYQ, seg_pos={0 0}, upload=49427]: Done uploading piece. err: ecclient: upload failed (node:12MaiBbEtrHEaXrMy5hhbYDQsGfTCZuT6C62aFxUnXPE5vRW3kg, address:104.36.82.59:4334): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 22:57:19.214748472 (61h46m19.098162114s) [seg_pos={0 0}, upload=49427]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 22:57:19.338605614 (61h46m19.222019241s) [upload=49427]: Done uploading segments... Jun 25 22:57:19.338670975 (61h46m19.222084591s) [upload=49427]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.12690985s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.282607798s FAIL (2025-06-25 04:48:16 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.282642001s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.357008516s FAIL (2025-06-25 04:47:58 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.357042385s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.113742372s FAIL (2025-06-25 04:47:04 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 2.11379336s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)