Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.365174639s FAIL (2025-10-27 20:58:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.365201209s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.546130587s FAIL (2025-10-27 20:58:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.546165452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.322991889s FAIL (2025-10-27 20:57:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.32301918s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.529962593s FAIL (2025-10-27 20:57:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.529994213s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.476066336s FAIL (2025-10-27 20:56:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.476095076s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.420860254s FAIL (2025-10-27 20:56:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.420888858s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.403718865s FAIL (2025-10-27 20:55:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.403744852s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.341082578s FAIL (2025-10-27 20:54:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.341126442s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.468854527s FAIL (2025-10-27 20:54:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.468882062s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.463965956s FAIL (2025-10-27 20:53:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.463996827s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.326615951s FAIL (2025-10-27 20:52:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.326645721s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.422443562s FAIL (2025-10-27 20:51:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.422469467s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.44648119s FAIL (2025-10-27 20:51:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.446509496s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.342490438s FAIL (2025-10-27 20:50:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.342523844s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.331981876s FAIL (2025-10-27 20:49:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.33203144s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.352844508s FAIL (2025-10-27 20:49:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.352970774s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.387898841s FAIL (2025-10-27 20:47:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.387931109s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.429853076s FAIL (2025-10-27 20:47:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.429909003s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.410899341s FAIL (2025-10-27 20:46:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.410927208s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.495156427s FAIL (2025-10-27 20:45:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.495187605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.523106667s FAIL (2025-10-27 20:45:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.523138475s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.406881189s FAIL (2025-10-27 20:44:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.406909522s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.606995208s FAIL (2025-10-27 20:44:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.607111389s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.426089089s FAIL (2025-10-27 20:43:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.426120405s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.364916087s FAIL (2025-10-27 20:43:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.364946241s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.483318294s FAIL (2025-10-27 20:42:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.483342516s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.521926147s FAIL (2025-10-27 20:42:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.521965748s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.385753227s FAIL (2025-10-27 20:40:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.385779491s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.399538726s FAIL (2025-10-27 20:40:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.399568453s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.527872892s FAIL (2025-10-27 20:40:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.527901565s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.489442658s FAIL (2025-10-27 20:39:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.489469378s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.422215798s FAIL (2025-10-27 20:38:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.422255491s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.44704483s FAIL (2025-10-27 20:36:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.447079743s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.608502911s FAIL (2025-10-27 20:36:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.608533402s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.505601451s FAIL (2025-10-27 20:35:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.505630596s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.558948214s FAIL (2025-10-27 20:34:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.558988736s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.534293106s FAIL (2025-10-27 20:33:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.53432454s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.391850786s FAIL (2025-10-27 20:33:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.391906322s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.483003708s FAIL (2025-10-27 20:32:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.483041109s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.483029714s FAIL (2025-10-27 20:32:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.483064005s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.57661529s FAIL (2025-10-27 20:31:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.57663423s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.456494432s FAIL (2025-10-27 20:30:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.456522254s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.369060066s FAIL (2025-10-27 20:29:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.369108423s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.519538992s FAIL (2025-10-27 20:28:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.519566622s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.356035536s FAIL (2025-10-27 20:28:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.356064647s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.432539553s FAIL (2025-10-27 20:27:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.432962127s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.347466867s FAIL (2025-10-27 20:27:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.347500338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.496391231s FAIL (2025-10-27 20:26:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.496428094s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.610185491s FAIL (2025-10-27 20:25:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.610366593s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.557881728s FAIL (2025-10-27 20:25:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== m: pb.BatchRequestItem_SegmentBegin Oct 27 20:17:32.861466220 (5h33m58.761629979s) [seg_pos={0 0}, upload=4950]: Begin upload segment... Oct 27 20:17:32.861541384 (5h33m58.761705142s) [seg_pos={0 0}, upload=4950]: Done begin upload segment. Oct 27 20:17:32.861585866 (5h33m58.761749627s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862350568 (5h33m58.762514335s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862667736 (5h33m58.762831497s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.862995651 (5h33m58.763159416s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863412645 (5h33m58.763576409s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.863807125 (5h33m58.763970887s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864220060 (5h33m58.76438382s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.864744383 (5h33m58.764908151s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866007098 (5h33m58.766170886s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866395097 (5h33m58.766558857s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.866815536 (5h33m58.766979295s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867066842 (5h33m58.767230607s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867452494 (5h33m58.767616255s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.867669881 (5h33m58.767833644s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868068984 (5h33m58.768232753s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:32.868167940 (5h33m58.768331703s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Uploading piece... Oct 27 20:17:33.480827882 (5h33m59.380991631s) [upload=4950]: Next returned nil segment Oct 27 20:17:33.480845543 (5h33m59.381009304s) [upload=4950]: Waiting for error group managing segments... Oct 27 20:17:33.608735875 (5h33m59.508899619s) [noise=true , address=45.91.116.9:4262 , piece_id=PH65DS3MII6SR3WT6R3NMKRVMJN5L35FYR2PETEASJBRU7256S4Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.611975113 (5h33m59.512138864s) [noise=true , address=77.90.31.17:4772 , piece_id=JE7IEOXZUMRZJDJ5I3MEJQBSZMA24KZLTGNWSTILKMTNY6UBPUSQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.612222441 (5h33m59.51238619s) [noise=true , address=45.91.116.12:4227 , piece_id=UJ4BEG3T4YCRDRASOPXECPTZPSI64US2TIXLMHMPMHWRST5VQULQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.656858713 (5h33m59.557022457s) [noise=true , address=77.90.31.18:4807 , piece_id=OWCB6FYU6M3X5YFJEBZEOEBKLVGW5URLI34QNMPL4YCXYBZRHC5Q, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:17:33.693058717 (5h33m59.593222468s) [noise=true , address=77.90.31.19:4842 , piece_id=VSS54GYE4E4KNLZTKE4ESAS3OJGIJRH5RPRTB7MO4QZQU4WZWIAA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: <nil> Oct 27 20:18:02.460299880 (5h34m28.36046365s) [noise=true , address=145.79.227.18:4005 , piece_id=HEXOBTE4SHMA573NMHGNUTWKH2RB76XG2GI5EPTLE3LWRN7TU3CQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460549546 (5h34m28.360713312s) [noise=true , address=145.79.227.5:4222 , piece_id=LQLHYZSGPMCIBNBCAVSXZ65QVOPTBIOKWJY5VLUDCPCFSEWZSYIA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460727205 (5h34m28.360890963s) [noise=true , address=145.79.227.8:4330 , piece_id=EH4O2NMTPHRZJX2FCD7TQRMVATK4AQYTC52WXKANEAPBLEBX3IJQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: rpc: dial tcp 145.79.227.8:4330: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460913305 (5h34m28.361077077s) [noise=true , address=145.79.227.13:4804 , piece_id=P7M6T26FJHUABYYWEQAFXLWNFGJ34XF4WNDA66L3HN3JHOHYQSOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:145.79.227.13:4804): protocol: rpc: dial tcp 145.79.227.13:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.460980509 (5h34m28.361144255s) [noise=true , address=145.79.227.24:4582 , piece_id=QCDRURPZPPUCBIK2APPDBW7VNHMXQYPVGAZW4PWRSSJH56OBN2XQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1YLhczXWKCwzCQxM97Q77HpiWNMe5E15Nv679FZo5uHw6MRXa, address:145.79.227.24:4582): protocol: rpc: dial tcp 145.79.227.24:4582: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461011646 (5h34m28.361175406s) [noise=true , address=145.79.227.17:4969 , piece_id=ZBXKQUQ6FI2L5BBHARWQUB7J7EEFNBKOAGK2KUBLA3DMDOFL3XOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461212878 (5h34m28.361376637s) [noise=true , address=145.79.227.20:4437 , piece_id=ZUYNM2DMBSW6BXI7BZ24SJZLM6VB4BNATY6PX65RHZTKXEILE2IQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1G3fe4SHMdNAjAmqLNyFb6qDKL94aAWGYE9qhczKmozKFhKKEV, address:145.79.227.20:4437): protocol: rpc: dial tcp 145.79.227.20:4437: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461253812 (5h34m28.361417581s) [noise=true , address=145.79.227.19:4079 , piece_id=SUANPYGFHXK3ADPPKKN2FC2MONKFGI7CRE2DY5FUJZQJB46IVHOQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:145.79.227.19:4079): protocol: rpc: dial tcp 145.79.227.19:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461431143 (5h34m28.361594908s) [noise=true , address=145.79.227.3:4151 , piece_id=IEADA2QOWZCBZ2X5V7VA7Z62L4NHX6IU5OEZA265WXT263SUN4MA, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:145.79.227.3:4151): protocol: rpc: dial tcp 145.79.227.3:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461558316 (5h34m28.361722083s) [noise=true , address=145.79.227.9:4365 , piece_id=EAMK66FOQ5TFPF6YGOWOEFL6CBGHBW2YA3I33O4532A67H6TPC2A, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12rvMymD9ejLTfLTfeF4VAycp2SdGUMBtR3o45x8JeMkCDWpCHq, address:145.79.227.9:4365): protocol: rpc: dial tcp 145.79.227.9:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461568598 (5h34m28.361732367s) [noise=true , address=145.79.227.11:4730 , piece_id=QTPYZOHQAS3JRJLRHJCXQKXQ3CTC2SJXS3IRAPZG5JMKFVJGEEQQ, seg_pos={0 0}, upload=4950]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 27 20:18:02.461676540 (5h34m28.3618403s) [seg_pos={0 0}, upload=4950]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Oct 27 20:18:02.570233312 (5h34m28.470397063s) [upload=4950]: Done uploading segments... Oct 27 20:18:02.570272260 (5h34m28.470436029s) [upload=4950]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration:* 2.557931424s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)