Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.359391968s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:46:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.359570214s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.406576611s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:45:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.406602549s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.333617709s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:44:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.333651213s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.276732808s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:43:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.276767759s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.379421264s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:43:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.379454262s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.294704453s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:42:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.294746359s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.36482807s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:42:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.364870103s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.40444345s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:41:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.404475954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.323744506s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:40:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.323775193s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.315024376s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:39:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.315053996s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.321660436s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:38:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.321692349s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.45957684s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:38:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.459612842s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.4114483s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:36:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.411492528s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.320799371s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:35:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.320834598s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.378447888s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:34:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.378479573s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.443803764s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:33:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.443933338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.418392192s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:33:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.418415027s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.29107174s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:32:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.291106012s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.465240984s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:31:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.465273819s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.351953286s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:31:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.351985698s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.564552075s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:30:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.564599243s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.406643029s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:29:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.406700742s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.332517589s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:28:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.332565261s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.373449108s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:27:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.373481725s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.382415104s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:27:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.382436338s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.435253564s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:26:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.435287954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.624722237s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:25:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.624749934s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.355354736s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:24:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.355386384s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.34575215s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:23:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.345784186s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.453833059s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:22:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.453929466s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.304756283s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:21:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.304877435s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.349938135s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:20:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.349968605s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.382942834s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:20:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.382977799s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.385010007s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:19:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.385042952s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.455863121s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:18:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.455967322s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.338058037s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:17:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.338091448s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.353667308s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:17:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.35370326s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.411609306s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:16:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.411640857s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.414595617s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:15:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.414628531s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.349951994s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:15:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.350054899s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.399018805s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:14:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.399047865s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.3591022s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:13:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.359132063s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.431887418s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:12:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.431925521s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.550810728s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:11:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.550840652s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.405759131s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:11:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.405802049s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.398872463s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:11:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.398902095s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.413247428s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:10:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.413292225s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.456033406s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:09:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.456081829s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.434778257s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:09:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.434872166s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.374175632s trace: https://jaeger.dev.storj.io/trace/3b09f358d3a8cbe1 FAIL (2025-11-10 04:08:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== ZFTPBVHQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.661556198 (256h26m7.363148673s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.665454063 (256h26m7.367046526s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.668482532 (256h26m7.370074999s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.671502653 (256h26m7.373095116s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.675154308 (256h26m7.376746772s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.678758271 (256h26m7.380350731s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:04.682994960 (256h26m7.384587423s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Uploading piece... Nov 10 04:07:05.306999595 (256h26m8.008592045s) [upload=225516]: Next returned nil segment Nov 10 04:07:05.307014203 (256h26m8.008606667s) [upload=225516]: Waiting for error group managing segments... Nov 10 04:07:05.444220454 (256h26m8.145812917s) [noise=true , address=77.90.31.15:4699 , piece_id=EVCDT3LRX36TFUTM77JIENYHMMD6A4DXK52NB7BXLYGXO6FGHLDA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.451767504 (256h26m8.153359957s) [noise=true , address=77.90.31.12:4592 , piece_id=6EEWGCA7Y3FBSLXW75RIFRS5XDS6X2NJVKD4QKP4UJRSMHYT7SJQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:05.459363315 (256h26m8.160955777s) [noise=true , address=77.90.31.18:4806 , piece_id=WZZWF4TQAJIKO2VZ2A25MSAMEIRM7MRWFGBDZW233YJMZFTPBVHQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:06.199674203 (256h26m8.901266653s) [noise=true , address=145.79.227.15:4875 , piece_id=DGHU2DHRFP2WXVHPHRRYSIABFUFPOJWCEHLBFHHSB6JSFDGOZ22A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: <nil> Nov 10 04:07:34.173053276 (256h26m36.874645735s) [noise=true , address=145.79.227.16:4909 , piece_id=ZBFDJQRLYTGYMYIR5WIW7HN72YFZNRT27AETM6V6MATG66XOY5JA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34048->145.79.227.16:4909: use of closed network connection Nov 10 04:07:34.173221637 (256h26m36.874814096s) [noise=true , address=145.79.227.11:4730 , piece_id=6AB62ISS7NFCHEE26GPVBTXIAC7CCVBFK4V3VNP5CL7KBUPUSOPQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33710->145.79.227.11:4730: use of closed network connection Nov 10 04:07:34.173446017 (256h26m36.87503848s) [noise=true , address=145.79.227.7:4294 , piece_id=B2FWZ6PI22ZSCSJRZ2X4E6NMN6H36BC6AZIOTX7WIMT4EN5FVXSQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42906->145.79.227.7:4294: use of closed network connection Nov 10 04:07:34.173574406 (256h26m36.875166865s) [noise=true , address=145.79.227.21:4473 , piece_id=4ZFP7SWM42VN3HQONESEYD53NJR4LKUFF3DMF2OLZ3TMD7PJFS3A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46482->145.79.227.21:4473: use of closed network connection Nov 10 04:07:34.173711501 (256h26m36.875303962s) [noise=true , address=145.79.227.26:4655 , piece_id=DRWEQJH25FFBJ376NSRHSIKKTCQFQZFQETSKWB4OZOM4YSOCKRUQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1xpZx5VbgHmbepaS9ZXgHfp7SZGeYPEjuJddQeYPUVpDU4EGx5, address:145.79.227.26:4655): protocol: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47452->145.79.227.26:4655: use of closed network connection Nov 10 04:07:34.173846065 (256h26m36.875438526s) [noise=true , address=145.79.227.13:4802 , piece_id=ASZHXU5NAGA3OHJNWSSYOGXL3NC6G2YRVP7DVQFKDERJZTDUKJ2A, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4, address:145.79.227.13:4802): protocol: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40760->145.79.227.13:4802: use of closed network connection Nov 10 04:07:34.174056958 (256h26m36.875649419s) [noise=true , address=145.79.227.14:4840 , piece_id=6DH252TCBW5KCRH4RAWCZUUFCYZBSTX7I67ROAL66CA2V3N3T2PQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42448->145.79.227.14:4840: use of closed network connection Nov 10 04:07:34.174345626 (256h26m36.875938079s) [noise=true , address=145.79.227.23:4545 , piece_id=J5WXBOJKO5PJ77E4GWFIBGADT6SUB2PXQUSEMPSRUEMTUOBIBBLA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra, address:145.79.227.23:4545): protocol: read tcp 139.59.144.22:42072->145.79.227.23:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.174481151 (256h26m36.876073613s) [noise=true , address=145.79.227.26:4654 , piece_id=RFU6W5RZAQAISIYYBE42SER2WP3BCC4II6ECU7DNDFIVS4VKIDMA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah, address:145.79.227.26:4654): protocol: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46802->145.79.227.26:4654: use of closed network connection Nov 10 04:07:34.174666791 (256h26m36.876259257s) [noise=true , address=145.79.227.27:4690 , piece_id=HMIQNZADYF5X3VGKQVUYBIT4QKAP3WP4MWFKSD6WYWIFLOU7HRHA, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12fyCro9gG2d3myk6Cju5vmf4CbkqbJN2PKAP8EbpcT1Rtao27H, address:145.79.227.27:4690): protocol: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54484->145.79.227.27:4690: use of closed network connection Nov 10 04:07:34.174965589 (256h26m36.876558045s) [noise=true , address=145.79.227.10:4403 , piece_id=YTDBFQ5BNOO36YSSFB2CTJQDLL74FTZKRZSDZ23NQTNDGKN7NEWQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:145.79.227.10:4403): protocol: read tcp 139.59.144.22:49306->145.79.227.10:4403: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175095672 (256h26m36.876688135s) [noise=true , address=145.79.227.8:4330 , piece_id=FTSHIMVXJORWQSCUQLGFZUFDOASNBA46HDC3QA4AV2IZYSUU4HNQ, seg_pos={0 0}, upload=225516]: Done uploading piece. err: ecclient: upload failed (node:125pLUE8mHgK5ZuhphNhDfjNB2kTM88jKNtraf7MMUDC9DU2YVW, address:145.79.227.8:4330): protocol: read tcp 139.59.144.22:55082->145.79.227.8:4330: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 10 04:07:34.175131671 (256h26m36.876724111s) [seg_pos={0 0}, upload=225516]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Nov 10 04:07:34.291181778 (256h26m36.992774235s) [upload=225516]: Done uploading segments... Nov 10 04:07:34.291260093 (256h26m36.99285255s) [upload=225516]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 2.374207241s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)