Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.825998224s FAIL (2025-06-26 00:01:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.826041023s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.040730011s FAIL (2025-06-26 00:00:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.040763764s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.980076433s FAIL (2025-06-26 00:00:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.980115828s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 3.14318777s FAIL (2025-06-25 23:59:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.143281288s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.908492186s FAIL (2025-06-25 23:58:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.908523684s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.950189925s FAIL (2025-06-25 23:57:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.950215649s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.538603762s FAIL (2025-06-25 23:57:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 5.538658073s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.716367019s FAIL (2025-06-25 23:56:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.716408783s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 3.099445517s FAIL (2025-06-25 23:55:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.099476777s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 3.149095819s FAIL (2025-06-25 23:55:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.149131282s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 3.019275994s FAIL (2025-06-25 23:54:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.019306807s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 3.029902984s FAIL (2025-06-25 23:53:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.029943114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.931728184s FAIL (2025-06-25 23:52:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.931755898s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.513844097s FAIL (2025-06-25 23:51:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.513873732s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 12.596888909s FAIL (2025-06-25 23:50:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 12.596926874s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 3.056817606s FAIL (2025-06-25 23:49:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.056850054s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 7.626112069s FAIL (2025-06-25 23:49:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 7.626144884s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.123650443s FAIL (2025-06-25 23:47:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.123682613s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.464494367s FAIL (2025-06-25 23:46:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.464522341s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.862260327s FAIL (2025-06-25 23:45:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.862290066s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.337731061s FAIL (2025-06-25 23:44:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.337763707s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X......................X....................................] duration: 5.640816873s FAIL (2025-06-25 23:44:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 5.640849242s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X......................X...................................] duration: 3.604718085s FAIL (2025-06-25 23:43:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.604753071s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X......................X..................................] duration: 2.884966269s FAIL (2025-06-25 23:42:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.884994727s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X......................X.................................] duration: 2.9581661s FAIL (2025-06-25 23:41:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.958194947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X......................X................................] duration: 4.654339832s FAIL (2025-06-25 23:40:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.654368285s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X......................X...............................] duration: 4.86094298s FAIL (2025-06-25 23:40:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.860975939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......X......................X..............................] duration: 2.606838342s FAIL (2025-06-25 23:39:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.606870011s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......X......................X.............................] duration: 2.844286036s FAIL (2025-06-25 23:37:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.844312975s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........X......................X............................] duration: 3.942458231s FAIL (2025-06-25 23:36:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.942507844s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration: 3.217821018s FAIL (2025-06-25 23:35:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.217859916s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration: 5.297782024s FAIL (2025-06-25 23:35:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 5.297816095s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................X.........................] duration: 4.920162737s FAIL (2025-06-25 23:34:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.920213807s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............X......................X........................] duration: 3.281568815s FAIL (2025-06-25 23:33:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.281607859s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration: 2.876157796s FAIL (2025-06-25 23:32:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.876186145s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................X......................] duration: 3.090038356s FAIL (2025-06-25 23:31:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.090077874s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................X.....................] duration: 4.617856406s FAIL (2025-06-25 23:30:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.617887673s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................X......................X....................] duration: 3.468913451s FAIL (2025-06-25 23:29:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.468945078s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................X...................] duration: 3.075386735s FAIL (2025-06-25 23:28:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.075417572s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................X..................] duration: 46.011125248s FAIL (2025-06-25 23:28:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 46.01115318s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................X.................] duration: 4.842449933s FAIL (2025-06-25 23:27:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.842480926s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................X................] duration: 3.001273668s FAIL (2025-06-25 23:26:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.001303163s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration: 9.86041304s FAIL (2025-06-25 23:26:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 9.860459233s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................X......................X..............] duration: 2.394078063s FAIL (2025-06-25 23:25:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.394115064s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration: 4.46517124s FAIL (2025-06-25 23:24:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.465201618s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................X......................X............] duration: 2.844724217s FAIL (2025-06-25 23:23:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.844753993s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration: 4.760092158s FAIL (2025-06-25 23:22:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 4.760119277s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration: 3.642953027s FAIL (2025-06-25 23:21:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 3.642983671s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration: 2.844941525s FAIL (2025-06-25 23:21:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.845045439s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................X......................X........] duration: 2.566295265s FAIL (2025-06-25 23:20:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== h item: pb.BatchRequestItem_ObjectCommit Jun 25 23:13:07.499969131 (62h2m7.383382759s) [upload=49644]: Done uploading segments... Jun 25 23:13:07.499997969 (62h2m7.383411592s) [upload=49644]: Upload finished. err: <nil> Jun 25 23:13:56.727086532 (62h2m56.610500166s) [upload=49655]: Starting upload Jun 25 23:13:56.727206950 (62h2m56.610620562s) [upload=49655]: Done starting upload Jun 25 23:13:56.727262984 (62h2m56.6106766s) [upload=49655]: Uploading segments... Jun 25 23:13:56.727632621 (62h2m56.611046258s) [upload=49655]: Got next segment. Inline: false Jun 25 23:13:56.727752080 (62h2m56.611165707s) [upload=49655]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 25 23:13:56.727759133 (62h2m56.611172769s) [upload=49655]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 25 23:13:56.923225933 (62h2m56.806639554s) [seg_pos={0 0}, upload=49655]: Begin upload segment... Jun 25 23:13:56.923319721 (62h2m56.806733357s) [seg_pos={0 0}, upload=49655]: Done begin upload segment. Jun 25 23:13:56.923369087 (62h2m56.806782723s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923394566 (62h2m56.806808195s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923479347 (62h2m56.806892981s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923897794 (62h2m56.807311427s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.923910519 (62h2m56.807324148s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924355837 (62h2m56.807769472s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924394574 (62h2m56.807808209s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924763483 (62h2m56.808177104s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.924850975 (62h2m56.80826462s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925313124 (62h2m56.80872675s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.925714261 (62h2m56.809127891s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.930419169 (62h2m56.81383281s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931155289 (62h2m56.814568926s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.931601021 (62h2m56.815014661s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932093427 (62h2m56.815507065s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.932631891 (62h2m56.816045529s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933179972 (62h2m56.816593611s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:56.933691799 (62h2m56.817105438s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Uploading piece... Jun 25 23:13:57.503700441 (62h2m57.387114084s) [upload=49655]: Next returned nil segment Jun 25 23:13:57.503723306 (62h2m57.387136953s) [upload=49655]: Waiting for error group managing segments... Jun 25 23:13:57.651649118 (62h2m57.535062755s) [noise=true , address=77.90.31.12:4613 , piece_id=NOZOL46F6OQUATOEEOGFO3HONUTHVXC66244UFMY3REOMGYSX3PQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.657241000 (62h2m57.540654626s) [noise=true , address=45.91.116.9:5283 , piece_id=67IELARJXESEO3A2FYQYTSN4F2WGZBS7ZXT5WRBNFNL5LVUCQ4LQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.661788551 (62h2m57.545202165s) [noise=true , address=104.36.82.45:4914 , piece_id=5ODWOW4DNSOSD3W7NKPH6JNRQFWTVIY4H76D543YUYGAU2AX6DDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.669325868 (62h2m57.552739504s) [noise=true , address=104.36.82.55:4211 , piece_id=3AJM5TFNS3XRXMGX5M5Z446MLPQS3HLZQSEYPU2H5KBZ462LV3DQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.677957894 (62h2m57.561371507s) [noise=true , address=104.36.82.9:4015 , piece_id=J5OO5B2TR56IOWMUCVCDADKDEHBD7U72GHDN3Z7GY2OI7E2PYLYA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.684061424 (62h2m57.56747506s) [noise=true , address=104.36.82.14:4229 , piece_id=DGJEC7SKQKGUBZRJJEKGH6BL2KW3IDTMCJPSY76N3FMYAOY6QGDQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.711932935 (62h2m57.595346555s) [noise=true , address=77.90.31.19:4854 , piece_id=3WTTCHURJ7A2WGODNDGB45SZGZZ2NZ4ODQLOFZYLKACZZZLX3L5A, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.740982244 (62h2m57.624395863s) [noise=true , address=104.36.82.8:4985 , piece_id=J5O2MLAJMGA2OR7MDZURSDIM4ZBQDMU5B44KFNWF7P3FWM732X7Q, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:57.767577594 (62h2m57.650991206s) [noise=true , address=104.36.82.10:4095 , piece_id=6NYYLHHWEDRMKHOCRJTVPXNZ4OFOSNQMV2OE7RMVMROVF4PWUBJA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.165997981 (62h2m58.049411614s) [noise=true , address=64.49.13.138:4486 , piece_id=JPXIQT2AOYCF2ES46LQWNN4LPOYWAYIMYGCSZLSQTADVVJUDLPOQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.180518091 (62h2m58.063931711s) [noise=true , address=79.127.205.234:4599 , piece_id=WDS3Z6KGNE54VTUSFL72CQKSVVAYXHM6XXT55B73AHS46GN72NPA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:13:58.298518298 (62h2m58.181931918s) [noise=true , address=104.36.82.58:4273 , piece_id=OS3CZNX4NTKLUGHQGBDTSJ4F4SNYXVXUBRLOIHPMV5ABRVMUEZPQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:00.300195347 (62h3m0.183608981s) [noise=true , address=104.36.82.5:4860 , piece_id=T2CCCNSG36J5MLMRIAZMLZBB4RUCYHMPPVUS2XY4RGK7KNKA5RVQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: <nil> Jun 25 23:14:56.442758240 (62h3m56.326171854s) [noise=true , address=104.36.82.61:4408 , piece_id=3OA7IRJPJI2NJ47JZHVVR3LBDEZZIVKKX53CPT4EP5KWYQVDRRRQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:1C534MWiH9eyz3HnKEMgogMTFXWXsBWef5QZmu8sDPx8rrcKVv, address:104.36.82.61:4408): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442790952 (62h3m56.326204587s) [noise=true , address=104.36.82.59:4316 , piece_id=HAXQVIUD5YGP7T7AHJVFJ7K7UEV7YNILJY2S3STM4SXSHM5QIBEA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:124WiP4Umxs7oHKtCpaQrysLxRDsrmqkyTCs2Ps38ZjM2LPvVhn, address:104.36.82.59:4316): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442899758 (62h3m56.326313447s) [noise=true , address=104.36.82.62:4410 , piece_id=QNHZ3RPBRMDXT44AUHE4ZKGOSOKOEL56VGJ6CPEZB5MKIZVOOMLA, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12HWX3mC14qJg7WdCetaBtS2GcGQFhzSaqUbKrYFBHZKdyFAAgX, address:104.36.82.62:4410): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442957149 (62h3m56.326370761s) [noise=true , address=104.36.82.61:4387 , piece_id=RWOF5FKJRHIMCCLFUGTVVCQ3YAYW7VG7WN5YLVSYXWVE2VDH53IQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12P4wAXSyaRY9poPRK5q4td8DJM69xWioG38TTwLTHKHA7QFxLp, address:104.36.82.61:4387): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.442980478 (62h3m56.32639409s) [noise=true , address=104.36.82.23:4460 , piece_id=KARG4FID7W47RK64WICR2ZSASDUA2GUELXQZRIURAI7UF4W4CMTQ, seg_pos={0 0}, upload=49655]: Done uploading piece. err: ecclient: upload failed (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn, address:104.36.82.23:4460): protocol: expected piece hash; context deadline exceeded; EOF Jun 25 23:14:56.443023525 (62h3m56.326437167s) [seg_pos={0 0}, upload=49655]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 25 23:14:56.558935011 (62h3m56.442348631s) [upload=49655]: Done uploading segments... Jun 25 23:14:56.558961236 (62h3m56.442374863s) [upload=49655]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 2.56632948s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)